-- Logs begin at Tue 2022-07-26 07:07:57 UTC, end at Tue 2022-07-26 08:47:00 UTC. -- Jul 26 07:37:53.431653 dv-cinder-836973-16-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 07:37:53.439526 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 07:37:53.441523 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 07:37:53 2022] *** Jul 26 07:37:53.441523 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 07:37:53.441523 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 07:37:53.441523 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: nodename: dv-cinder-836973-16-iscsi Jul 26 07:37:53.441523 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: machine: x86_64 Jul 26 07:37:53.441523 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: clock source: unix Jul 26 07:37:53.441523 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: pcre jit disabled Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: detected number of CPU cores: 4 Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: current working directory: / Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: detected binary path: /usr/bin/uwsgi-core Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: your processes number limit is 47680 Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: your memory page size is 4096 bytes Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: detected max file descriptor number: 2048 Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: lock engine: pthread robust mutexes Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: thunder lock: enabled Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 07:37:53.441965 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 07:37:53.482420 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: Python main interpreter initialized at 0x5652dc0d79c0 Jul 26 07:37:53.482420 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: python threads support enabled Jul 26 07:37:53.482420 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: your server socket listen backlog is limited to 100 connections Jul 26 07:37:53.482420 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: your mercy for graceful operations on workers is 90 seconds Jul 26 07:37:53.482801 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 07:37:53.482877 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: *** Operational MODE: preforking *** Jul 26 07:37:53.483180 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: *** uWSGI is running in multiple interpreter mode *** Jul 26 07:37:53.483180 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: spawned uWSGI master process (pid: 91851) Jul 26 07:37:53.483378 dv-cinder-836973-16-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 26 07:37:53.484480 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: spawned uWSGI worker 1 (pid: 91860, cores: 1) Jul 26 07:37:53.484480 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: spawned uWSGI worker 2 (pid: 91861, cores: 1) Jul 26 07:37:53.484480 dv-cinder-836973-16-iscsi devstack@keystone.service[91851]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 07:37:58.973206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:37:58.973206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: from cryptography.utils import int_from_bytes Jul 26 07:37:58.973984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:37:58.973984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: from cryptography.utils import int_from_bytes Jul 26 07:37:58.974428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:37:58.974428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: from cryptography.utils import int_from_bytes Jul 26 07:37:58.974557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 07:37:58.974557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: from cryptography.utils import int_from_bytes Jul 26 07:37:59.023383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 07:37:59.023535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 07:37:59.023615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 07:37:59.023690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 07:37:59.023750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] command line args: [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 07:37:59.023813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] command line args: [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 07:37:59.024026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 07:37:59.024114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 07:37:59.024190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ================================================================================ {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 07:37:59.024260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ================================================================================ {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 07:37:59.024446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] admin_token = **** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.024523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] admin_token = **** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.024695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] config_dir = [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.024774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] config_dir = [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.024880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.024962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.025064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] config_source = [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.025142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] config_source = [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.025247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] debug = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.025326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] debug = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.025441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.025742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.025879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.025981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.026081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.026173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.026274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.026375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.026469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.026606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.027254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] list_limit = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.027355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] list_limit = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.027454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] log_config_append = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.027559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] log_config_append = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.027659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.027759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.027852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] log_dir = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.027951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] log_dir = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] log_file = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] log_file = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028542 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.028999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.029937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.030053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.030137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.030276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.030356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.030498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.030589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.030745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.030832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.031009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.031103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.031287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.031366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.031779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.031866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.031945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] publish_errors = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] publish_errors = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.032952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033266 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] standard_threads = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] standard_threads = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.033983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] use_journal = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] use_journal = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] use_json = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] use_json = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] use_stderr = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] use_stderr = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] use_syslog = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] use_syslog = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.034874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 07:37:59.035075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.035154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.035315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.035406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.035573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.035651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.035811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.035887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.036070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.036148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.036311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.036391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.036557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.036640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.036792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.036869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.037036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.037113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.037281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.037357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.037527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.037605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.037758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.037841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.038003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.038081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.038239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.038320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.038481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.038562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.038725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.038839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.039952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.040027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.040201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.040276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.040464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.040548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.040717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.040792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.040963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.041997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.042118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.042195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.042391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.042474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.042619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.042700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.042850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.042981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.043119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.043209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.043367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.043442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.043601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.043682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.043846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.043935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.044983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.045059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.045212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.045297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.045436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.045516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.045671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.045778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.045915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046146 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.046949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.047099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.047178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.047345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.047437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.047574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.047646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.047808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.047890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.048972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.049052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.049217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.049333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.049452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.049530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.049685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.049769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.049916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.050991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.051132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.051218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.051398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.051475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.051634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.051752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.051882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.051960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.052123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.052198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.052357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.052433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.052591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.052670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.052825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.052900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.053996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.054073 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.054233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.054311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.054466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.054553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.054700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.054784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.054949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.055040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.055210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.055288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.055450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.055529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.055692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.055769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.055929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.056943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.057087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.057165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.057313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.057389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.057540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.057623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.058281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.058366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.058515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.058595 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.058756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.058834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.059010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.059091 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.059260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.059340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.059496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.059579 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.059749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.059828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] auth.external = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] auth.external = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.060998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.061105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.061232 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.061319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.061461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] auth.password = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.061539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] auth.password = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.061690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] auth.token = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.061772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] auth.token = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.061928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.062014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.062160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.062238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.062405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.062482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.062634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.062718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.062879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] credential.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] credential.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.063934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.064100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.064188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.064345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.064424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.064581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.064824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.064912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.065055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.065132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.065318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.065394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.065568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.065653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.065803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.065882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.066054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.066133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.066331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.066416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.066574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.066652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.066836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.066923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.067102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.067194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.067358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.067437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.067592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] federation.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.067669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] federation.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.067829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.067915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.068080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.068157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.068322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.068398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.068553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.068638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.068795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.068872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.069033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.069114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.069281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.069366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.069517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.069595 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.069771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.069848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.070005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.070090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.070261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.070339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.070495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.070572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.070742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.070898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.071956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.072999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.073154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.073283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.074014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.074153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.074293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.074432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.074560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.074686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.074686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.074985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.075120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.075251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.075379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.075506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.075633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.075759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.075894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.076022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.076160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.076289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.076415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.076538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.076671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.076800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.076923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.077045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.077167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.077290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.077420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.077544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.077666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.077794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.077930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.078053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.078184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.078309 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.078431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.078552 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.078674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.078796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.078971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.079097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.079224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.079361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.079487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.079623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.079758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.079883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.080015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.080145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.080271 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.080403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.080537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.080663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.080790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.080915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.081041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.081166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.081300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.081438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.081564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.081690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.081816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.081942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.082075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.082202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.082329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.082457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.082582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.082708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.082842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.082984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.083117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.083252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.083375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.083499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.083629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.083752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.083874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.083995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.084117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.084239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.084368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.084493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.084616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.084738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.084870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.085986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.086229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.086351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.086481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.086614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.086737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.086858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.087024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.087148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.087290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.087416 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.087543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.087670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.087795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.087921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.088054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.088180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.088306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.088442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.088569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.088695 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.088829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.088955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.089077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.089199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.089324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.089450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.089584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.089711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.089839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.089965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.090099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.090225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.090361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.090488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.090614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.090740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.090866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.091995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.092116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.092237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.092358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.092479 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.092609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.092731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.092853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.092974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.093095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.093215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.093345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] resource.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.093466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.093598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.093719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] resource.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.093840 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.093962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.094091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.094213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.094341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.094462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.094584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.094705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.094835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.094977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.095101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.095228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.095363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.095490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.095691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.095819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.095946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] role.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.096073 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.096199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] role.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.096326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] role.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.096460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.096588 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] role.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.096715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.096877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.097015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.097156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.097291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.097418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.097546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.097672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.097800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.097935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.098059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.098187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.098314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.098432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.098559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.098717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.098850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.099027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.099154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.099282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.099408 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.099542 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.099667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.099793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.099926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.100052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.100052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.100304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.100304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.100550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.100676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.100802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.100928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.101059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.101186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.101313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.101438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.101563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.101688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.101821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.101947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.102073 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.102199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.102334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.102461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.102594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.102719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.102845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.103265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.103391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.103514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.103646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.103770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.103893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.104015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.104137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.104277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.104402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.104525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.104647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.104770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.104892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.105022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.105144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.105268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] token.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.105389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.105512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.105634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] token.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.105764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.105887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.106020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.106162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.106284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.106406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.106537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.106660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.106782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.106904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.107072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.107199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.107336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.107469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.107596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.107732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.107858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.107983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.108116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.108242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.108370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.108495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.108621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.108746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.108880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.109005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.109131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.109257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.109383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.109518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.109652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.109779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.109905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.connection = **** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.110039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.110173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.110304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.connection = **** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.110439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.110571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.110698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.110698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.110959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.111084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.111206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.111339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.111463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.111596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.111720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.111844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.111966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.112088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.112210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.112344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.112469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.112592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.112714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.112837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.112959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.113098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.113221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.113344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.113467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.113590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.113712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.113844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.113967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.114090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.114213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.114335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.114459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.114594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 07:37:59.114729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.114729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 07:37:59.114729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 07:37:59.140332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.140563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.140788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.140917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.141044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.141239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.149358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.149798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.178581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.178814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.179020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.179167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.231457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.231734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.281854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.282087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.282618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.282860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.346369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.346605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.346816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.347008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.347158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.347290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.347422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.347552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.347682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.347813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.347813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.348077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.370264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.371040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.371193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.371425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.371652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.371854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.372044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.372193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.372368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.372524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.372691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.372850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.373001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.373001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.384482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.384896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.398247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.398524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.398759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91861) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.399979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.400223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.400397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 07:37:59.416736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.416952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 07:37:59.417181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.417308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.417438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 07:37:59.417577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 07:37:59.417708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.417836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.417966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 07:37:59.418094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.418229 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.418358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.418497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.418625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.418752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.418880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.428181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.428463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.428594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.428718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.428843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.429003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.429132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.429267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.436440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.436684 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.441151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.441365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.441493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.441647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.441773 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.441927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.442062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.442193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.442408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.442533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.442662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.442800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.442954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.443084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.443209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.443332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.443455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.443589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.443714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.443853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.443978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.444102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.467222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.467394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.468723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.468877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.469003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.469139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.473621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.473763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.473889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.474013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.474173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.474312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.481322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.481477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.481602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.481728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.485691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.485823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.485985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.486112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.486277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.486414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.486540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.486665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.486813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.486967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.487119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.487259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.487394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.487529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.487654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.487779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.504073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.504213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.504364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.504491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.508294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.508443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.511460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.511603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.511754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.511881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.516135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.516269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.519322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.519454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.522742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.522888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.523066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.523203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.523360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.523486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.523651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.523777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.523927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.524053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.524212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.524347 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.540138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.540289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.540417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.540541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.540666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.540804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.540930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.541054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.548311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.548451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.549842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.549972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.550145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.550280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.552915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.553047 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.553188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.553320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.553476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.553603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.553757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.553894 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.554048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.554188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.565951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.566088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.566230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.566357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.566490 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.566617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.566750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.566876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.567050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.567188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.567318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.567448 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.567588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.567720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.583072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.583221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.586033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.586171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.589040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.589183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.591497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.591655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.593014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.593174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.593301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.593464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.593591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.593749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.600064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.600248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.601608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.601836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.604558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.605324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.605454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.605616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.605744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.605903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.606038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.606170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.614193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.614364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.614495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.614655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.614799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.614950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.622409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91861) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.622549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 07:37:59.622676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.622812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.622997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.623127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.623262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.623392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.623549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.623685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.623838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.623964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.624117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.624242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.624379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.624510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.624734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.624903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.625080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.625211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.625341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.625469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.625598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.625737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.625866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.625995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.626123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.626262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91861) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 07:37:59.659570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652dc0d79c0 pid: 91860 (default app) Jul 26 07:37:59.659727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652dc0d79c0 pid: 91861 (default app) Jul 26 07:37:59.662872 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff28c6f-26ee-4362-a6e8-3e64dd5bdf5c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:37:59.663183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff28c6f-26ee-4362-a6e8-3e64dd5bdf5c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:37:59.663459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff28c6f-26ee-4362-a6e8-3e64dd5bdf5c None None] PATH_INFO: `/v3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:37:59.668320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Tue Jul 26 07:37:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:07.246951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0332-2820-48bc-8e31-6fd109547b98 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:07.247522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0332-2820-48bc-8e31-6fd109547b98 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:07.247522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0332-2820-48bc-8e31-6fd109547b98 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:07.251953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:07.257115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:07.257541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:07.257666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:07.329917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: INFO dbcounter [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] Registered counter for database keystone Jul 26 07:38:07.350538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG oslo_db.sqlalchemy.engines [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:38:07.356921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writer thread running {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:38:07.535389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG passlib.handlers.bcrypt [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91860) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 07:38:07.535725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG passlib.handlers.bcrypt [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91860) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 07:38:07.591108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:07.592925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:07.717428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 07:38:07.861570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0332-2820-48bc-8e31-6fd109547b98 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:07.930218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: INFO dbcounter [None req-0fdf0332-2820-48bc-8e31-6fd109547b98 None None] Registered counter for database keystone Jul 26 07:38:07.949208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG oslo_db.sqlalchemy.engines [None req-0fdf0332-2820-48bc-8e31-6fd109547b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 07:38:07.955311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writer thread running {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 07:38:08.072244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0332-2820-48bc-8e31-6fd109547b98 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:08.076477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046be84-5eca-41da-b992-dc108d69016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:08.077122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046be84-5eca-41da-b992-dc108d69016c admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:08.077403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046be84-5eca-41da-b992-dc108d69016c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:08.077679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046be84-5eca-41da-b992-dc108d69016c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:08.085589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046be84-5eca-41da-b992-dc108d69016c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:08.137247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4046be84-5eca-41da-b992-dc108d69016c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 07:38:08.137539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046be84-5eca-41da-b992-dc108d69016c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:08.147446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Tue Jul 26 07:38:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:38:08.153824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:08.168650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148060db-8955-4cb2-8c02-d78389dbc0ff None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:08.173068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17b69-2410-475d-9cf3-d9420dac5ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:08.174172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17b69-2410-475d-9cf3-d9420dac5ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:08.174460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17b69-2410-475d-9cf3-d9420dac5ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:08.174745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17b69-2410-475d-9cf3-d9420dac5ca2 admin admin] PATH_INFO: `/v3/projects/4e4e301f72114302a7a6060f88f11bb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:08.176269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17b69-2410-475d-9cf3-d9420dac5ca2 admin admin] RBAC: Authorizing `identity:get_project(project_id=4e4e301f72114302a7a6060f88f11bb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:08.226674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING keystone.common.rbac_enforcer.enforcer [None req-17a17b69-2410-475d-9cf3-d9420dac5ca2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 07:38:08.227041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17b69-2410-475d-9cf3-d9420dac5ca2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:08.232266 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Tue Jul 26 07:38:08 2022] GET /identity/v3/projects/4e4e301f72114302a7a6060f88f11bb3 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:10.184604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058fd91-d677-45ef-b694-70049cedd522 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:10.185099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058fd91-d677-45ef-b694-70049cedd522 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:10.185197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058fd91-d677-45ef-b694-70049cedd522 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:10.189306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:10.194705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7784e-8ff5-4dc8-8ef7-4542f1a0aa0a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:10.195153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7784e-8ff5-4dc8-8ef7-4542f1a0aa0a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:10.195314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7784e-8ff5-4dc8-8ef7-4542f1a0aa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:10.216332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a1b7784e-8ff5-4dc8-8ef7-4542f1a0aa0a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:10.217865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a1b7784e-8ff5-4dc8-8ef7-4542f1a0aa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:10.225789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 07:38:10.247011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058fd91-d677-45ef-b694-70049cedd522 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:10.258899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058fd91-d677-45ef-b694-70049cedd522 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:10.263620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219889d7-0760-431b-a176-4ae84459222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:10.264222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219889d7-0760-431b-a176-4ae84459222b admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:10.264506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219889d7-0760-431b-a176-4ae84459222b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:10.264781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219889d7-0760-431b-a176-4ae84459222b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:10.272660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219889d7-0760-431b-a176-4ae84459222b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:10.274437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219889d7-0760-431b-a176-4ae84459222b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:10.283737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Tue Jul 26 07:38:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:38:10.288905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7784e-8ff5-4dc8-8ef7-4542f1a0aa0a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:10.297894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7784e-8ff5-4dc8-8ef7-4542f1a0aa0a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:10.302296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf670ec4-19c4-4672-aa2e-b245fca6dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:10.302952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf670ec4-19c4-4672-aa2e-b245fca6dac4 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:10.303243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf670ec4-19c4-4672-aa2e-b245fca6dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:10.303525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf670ec4-19c4-4672-aa2e-b245fca6dac4 admin admin] PATH_INFO: `/v3/users/312d9f01937f4f95a328912567973a43` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:10.304897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf670ec4-19c4-4672-aa2e-b245fca6dac4 admin admin] RBAC: Authorizing `identity:get_user(user_id=312d9f01937f4f95a328912567973a43)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:10.306726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf670ec4-19c4-4672-aa2e-b245fca6dac4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:10.308813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Tue Jul 26 07:38:10 2022] GET /identity/v3/users/312d9f01937f4f95a328912567973a43 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:12.339801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd43f-1af9-4068-be58-40f148285b9c None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:12.340315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd43f-1af9-4068-be58-40f148285b9c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:12.340396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd43f-1af9-4068-be58-40f148285b9c None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:12.341699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:12.346732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdac78f-9d2e-414f-aa6f-2ffbfad16f6a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:12.347183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdac78f-9d2e-414f-aa6f-2ffbfad16f6a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:12.347340 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdac78f-9d2e-414f-aa6f-2ffbfad16f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:12.366272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4cdac78f-9d2e-414f-aa6f-2ffbfad16f6a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:12.367501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4cdac78f-9d2e-414f-aa6f-2ffbfad16f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:12.409509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c313e-aa4d-4a39-9289-230c8677c104 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:12.409794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c313e-aa4d-4a39-9289-230c8677c104 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:12.410074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c313e-aa4d-4a39-9289-230c8677c104 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:12.411607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:12.416092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:12.416379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:12.416658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:12.447822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:12.457829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG passlib.handlers.bcrypt [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91861) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 07:38:12.458285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG passlib.handlers.bcrypt [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91861) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 07:38:12.471149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdac78f-9d2e-414f-aa6f-2ffbfad16f6a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:12.493985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:12.503804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:12.505394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:12.573280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdac78f-9d2e-414f-aa6f-2ffbfad16f6a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:12.605372 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:12.607351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078f8a-4b79-4b16-8080-32c133982961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:12.608001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078f8a-4b79-4b16-8080-32c133982961 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:12.608284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078f8a-4b79-4b16-8080-32c133982961 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:12.608560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078f8a-4b79-4b16-8080-32c133982961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:12.619458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078f8a-4b79-4b16-8080-32c133982961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:12.627253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-5b078f8a-4b79-4b16-8080-32c133982961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:12.628730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:12.629635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:12.630677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:12.635559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078f8a-4b79-4b16-8080-32c133982961 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:12.715452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:12.727813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ec98-db75-4177-a461-f192a1471688 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:12.730158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:12.733753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078f8a-4b79-4b16-8080-32c133982961 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:12.767489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f9f81-f5ac-4c32-9381-86cd6d570cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:12.767741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:12.768350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f9f81-f5ac-4c32-9381-86cd6d570cfe None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:12.768453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:12.768633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:12.768727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f9f81-f5ac-4c32-9381-86cd6d570cfe None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:12.768908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f9f81-f5ac-4c32-9381-86cd6d570cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:12.769001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:12.769643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:12.769953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:12.771670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:12.783234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:12.788840 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:12.835558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f9f81-f5ac-4c32-9381-86cd6d570cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:12.837080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f9f81-f5ac-4c32-9381-86cd6d570cfe None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:12.940354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 07:38:12.946251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f9f81-f5ac-4c32-9381-86cd6d570cfe None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:12.950022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:12.996393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabff5a-fc8f-40d1-b1e0-7cab99671a32 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:13.029730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b989d4-1dc6-4c06-a2d0-9c9a209c78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:13.030446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b989d4-1dc6-4c06-a2d0-9c9a209c78b1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:13.030736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b989d4-1dc6-4c06-a2d0-9c9a209c78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:13.031046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b989d4-1dc6-4c06-a2d0-9c9a209c78b1 None admin] PATH_INFO: `/v3/users/312d9f01937f4f95a328912567973a43` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:13.032282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b989d4-1dc6-4c06-a2d0-9c9a209c78b1 None admin] RBAC: Authorizing `identity:get_user(user_id=312d9f01937f4f95a328912567973a43)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:13.033736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b989d4-1dc6-4c06-a2d0-9c9a209c78b1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:13.035440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:12 2022] GET /identity/v3/users/312d9f01937f4f95a328912567973a43 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:13.040727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b989d4-1dc6-4c06-a2d0-9c9a209c78b1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:13.047148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f9f81-f5ac-4c32-9381-86cd6d570cfe None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:13.055259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:13.082631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:13.083514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:13.083803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:13.084079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:13.101991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:13.103491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:38:13.122530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:13.123574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:13.124362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:38:13.124362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:38:13.124362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:38:13.124362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:13.124362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:13.129449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:13.142501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b989d4-1dc6-4c06-a2d0-9c9a209c78b1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:13.175960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8dd6f-f80b-4d65-93af-eece1d2583bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:13.176607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8dd6f-f80b-4d65-93af-eece1d2583bd None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:13.176892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8dd6f-f80b-4d65-93af-eece1d2583bd None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:13.177176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8dd6f-f80b-4d65-93af-eece1d2583bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:13.178343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8dd6f-f80b-4d65-93af-eece1d2583bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:13.179822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8dd6f-f80b-4d65-93af-eece1d2583bd None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:13.181547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:13.185457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:13.187745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8dd6f-f80b-4d65-93af-eece1d2583bd None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:13.228109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217f86f-34aa-4d1d-9d39-8a6e6d86366a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:13.261484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1d45b-86f0-4106-a220-93c49b75f6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:13.262102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1d45b-86f0-4106-a220-93c49b75f6b8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:13.262389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1d45b-86f0-4106-a220-93c49b75f6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:13.262677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1d45b-86f0-4106-a220-93c49b75f6b8 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:13.263406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1d45b-86f0-4106-a220-93c49b75f6b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:13.263712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1d45b-86f0-4106-a220-93c49b75f6b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:13.265103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1d45b-86f0-4106-a220-93c49b75f6b8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:13.266806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:13.282790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:13.286417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8dd6f-f80b-4d65-93af-eece1d2583bd None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:13.323387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a084c-cec7-469f-890b-c6c2646ca4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:13.324020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a084c-cec7-469f-890b-c6c2646ca4cd None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:13.324303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a084c-cec7-469f-890b-c6c2646ca4cd None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:13.324581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a084c-cec7-469f-890b-c6c2646ca4cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:13.325388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a084c-cec7-469f-890b-c6c2646ca4cd None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.domain.id=default, user.id=312d9f01937f4f95a328912567973a43) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:13.325700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a084c-cec7-469f-890b-c6c2646ca4cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:13.327250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a084c-cec7-469f-890b-c6c2646ca4cd None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:13.334685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1322 bytes} [Tue Jul 26 07:38:13 2022] GET /identity/v3/role_assignments?user.id=312d9f01937f4f95a328912567973a43&scope.domain.id=default&role.id=53894f3146884908ba6dd3e118397fb3 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:15.528095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7f77-5779-4bd4-bb24-ebaf8eabbbba None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:15.528623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7f77-5779-4bd4-bb24-ebaf8eabbbba None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:15.528623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7f77-5779-4bd4-bb24-ebaf8eabbbba None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:15.529973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:15.535501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5b558-aea8-4a27-afc0-ed667e9c7c0e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:15.535924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5b558-aea8-4a27-afc0-ed667e9c7c0e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:15.536136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5b558-aea8-4a27-afc0-ed667e9c7c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:15.564384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-fee5b558-aea8-4a27-afc0-ed667e9c7c0e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:15.565608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fee5b558-aea8-4a27-afc0-ed667e9c7c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:15.659926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:15.700999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e7f77-5779-4bd4-bb24-ebaf8eabbbba None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:15.844706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e7f77-5779-4bd4-bb24-ebaf8eabbbba None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:15.871317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:15.888843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f1cad-ee1d-4971-a8c8-49934b05f3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:15.889498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1cad-ee1d-4971-a8c8-49934b05f3bc None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:15.889793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1cad-ee1d-4971-a8c8-49934b05f3bc None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:15.895635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1cad-ee1d-4971-a8c8-49934b05f3bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:15.912086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f1cad-ee1d-4971-a8c8-49934b05f3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-101f1cad-ee1d-4971-a8c8-49934b05f3bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:15.918910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:15.919767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:15.920533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 12/24] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:15.932054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5b558-aea8-4a27-afc0-ed667e9c7c0e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:15.936427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494a4f-21f9-4308-b644-1ca0876b0493 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:15.936722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494a4f-21f9-4308-b644-1ca0876b0493 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:15.937011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494a4f-21f9-4308-b644-1ca0876b0493 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:15.938551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 13/25] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:15.943522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435835-08a0-4828-b60e-a0b16fab17cc None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:15.943815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435835-08a0-4828-b60e-a0b16fab17cc None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:15.944099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435835-08a0-4828-b60e-a0b16fab17cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:15.970244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-6d435835-08a0-4828-b60e-a0b16fab17cc None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:15.971467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6d435835-08a0-4828-b60e-a0b16fab17cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:16.063529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:16.096032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 14/26] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:16.097034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703fe7b-c9b8-4bdb-ad31-b2d749daca00 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.097321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703fe7b-c9b8-4bdb-ad31-b2d749daca00 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.097601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703fe7b-c9b8-4bdb-ad31-b2d749daca00 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.105591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 15/27] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:16.123419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5b558-aea8-4a27-afc0-ed667e9c7c0e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:16.134719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d47f-6484-425d-bcaa-e6e80c9dd08d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.135043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d47f-6484-425d-bcaa-e6e80c9dd08d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.135328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d47f-6484-425d-bcaa-e6e80c9dd08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.161671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-17b3d47f-6484-425d-bcaa-e6e80c9dd08d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:16.162895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-17b3d47f-6484-425d-bcaa-e6e80c9dd08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:16.167994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4064d2-8140-46be-a95f-ff15c39a1ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:16.168632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4064d2-8140-46be-a95f-ff15c39a1ece None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.168921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4064d2-8140-46be-a95f-ff15c39a1ece None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.169197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4064d2-8140-46be-a95f-ff15c39a1ece None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.169925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4064d2-8140-46be-a95f-ff15c39a1ece None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:16.170231 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4064d2-8140-46be-a95f-ff15c39a1ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:16.171703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4064d2-8140-46be-a95f-ff15c39a1ece None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:16.183131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 13/28] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:16.185026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1b166-0821-463f-8963-0041df631ee3 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.185474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1b166-0821-463f-8963-0041df631ee3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.185869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1b166-0821-463f-8963-0041df631ee3 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.187485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 14/29] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:16.188646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1b166-0821-463f-8963-0041df631ee3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:16.309327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1b166-0821-463f-8963-0041df631ee3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:16.346189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa90f-d088-4b60-84bf-8d3d40ac5994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:16.347078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa90f-d088-4b60-84bf-8d3d40ac5994 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.347502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa90f-d088-4b60-84bf-8d3d40ac5994 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.347916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa90f-d088-4b60-84bf-8d3d40ac5994 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.348777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fa90f-d088-4b60-84bf-8d3d40ac5994 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:16.350305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fa90f-d088-4b60-84bf-8d3d40ac5994 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:16.357000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:16.360093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 16/30] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 26 07:38:16.361300 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3d47f-6484-425d-bcaa-e6e80c9dd08d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:16.401741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:16.472772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3d47f-6484-425d-bcaa-e6e80c9dd08d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:16.500206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 15/31] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jul 26 07:38:16 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:16.501842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0439cc-163d-4be5-99f5-3578222ea3d2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.502142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0439cc-163d-4be5-99f5-3578222ea3d2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.502487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0439cc-163d-4be5-99f5-3578222ea3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.512654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430d66-e5bb-4786-8835-3526b692e480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:16.513558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430d66-e5bb-4786-8835-3526b692e480 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.514005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430d66-e5bb-4786-8835-3526b692e480 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.514428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430d66-e5bb-4786-8835-3526b692e480 None admin] PATH_INFO: `/v3/users/312d9f01937f4f95a328912567973a43` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.516128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430d66-e5bb-4786-8835-3526b692e480 None admin] RBAC: Authorizing `identity:get_user(user_id=312d9f01937f4f95a328912567973a43)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:16.517860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430d66-e5bb-4786-8835-3526b692e480 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:16.519634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 17/32] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:16 2022] GET /identity/v3/users/312d9f01937f4f95a328912567973a43 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:16.520892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430d66-e5bb-4786-8835-3526b692e480 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:16.528592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-cc0439cc-163d-4be5-99f5-3578222ea3d2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:16.530220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cc0439cc-163d-4be5-99f5-3578222ea3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:16.608470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 16/33] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:16.609176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0439cc-163d-4be5-99f5-3578222ea3d2 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:16.648783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430d66-e5bb-4786-8835-3526b692e480 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:16.658518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:16.719765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c06d3-212c-4528-9fa3-fe7859f3486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:16.720435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c06d3-212c-4528-9fa3-fe7859f3486d None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.720724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c06d3-212c-4528-9fa3-fe7859f3486d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.721007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c06d3-212c-4528-9fa3-fe7859f3486d None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.721760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c06d3-212c-4528-9fa3-fe7859f3486d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:16.723210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c06d3-212c-4528-9fa3-fe7859f3486d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:16.744264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0439cc-163d-4be5-99f5-3578222ea3d2 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:16.773355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:16.784395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74b50b-708c-4385-a583-0b168a84fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:16.785061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74b50b-708c-4385-a583-0b168a84fcae None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:16.785350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74b50b-708c-4385-a583-0b168a84fcae None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:16.785633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74b50b-708c-4385-a583-0b168a84fcae None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:16.786809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74b50b-708c-4385-a583-0b168a84fcae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:16.789115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74b50b-708c-4385-a583-0b168a84fcae None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:16.790728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 17/34] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:16.795763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74b50b-708c-4385-a583-0b168a84fcae None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:16.882561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 18/35] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jul 26 07:38:16 2022] POST /identity/v3/roles => generated 219 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:16.883882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c06d3-212c-4528-9fa3-fe7859f3486d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:16.934228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74b50b-708c-4385-a583-0b168a84fcae None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:17.029925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c06d3-212c-4528-9fa3-fe7859f3486d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:17.045525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9c513-b801-430b-99b2-a17d47cc4e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:17.046199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c513-b801-430b-99b2-a17d47cc4e90 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.046487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c513-b801-430b-99b2-a17d47cc4e90 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.046764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c513-b801-430b-99b2-a17d47cc4e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.062216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9c513-b801-430b-99b2-a17d47cc4e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:17.064140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9c513-b801-430b-99b2-a17d47cc4e90 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:17.073863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c737c7-ac2b-4a5b-b701-9fcce901f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:17.075093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c737c7-ac2b-4a5b-b701-9fcce901f3e9 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.075605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c737c7-ac2b-4a5b-b701-9fcce901f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.076088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c737c7-ac2b-4a5b-b701-9fcce901f3e9 None admin] PATH_INFO: `/v3/domains/default/users/312d9f01937f4f95a328912567973a43/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.078854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c737c7-ac2b-4a5b-b701-9fcce901f3e9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=312d9f01937f4f95a328912567973a43, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:17.080814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c737c7-ac2b-4a5b-b701-9fcce901f3e9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4ff9c513-b801-430b-99b2-a17d47cc4e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:38:17.084862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:17.085700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:17.086512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:38:17.086512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:38:17.086512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:38:17.086512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:17.086512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 18/36] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:17.087583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdd8c-2fa4-4092-9583-dfade6e196c6 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.087877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdd8c-2fa4-4092-9583-dfade6e196c6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.088159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdd8c-2fa4-4092-9583-dfade6e196c6 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.090993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 19/37] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:17.093185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bdd8c-2fa4-4092-9583-dfade6e196c6 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:17.108090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 19/38] 10.222.0.46 () {58 vars in 1361 bytes} [Tue Jul 26 07:38:16 2022] PUT /identity/v3/domains/default/users/312d9f01937f4f95a328912567973a43/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:17.110181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58964-caeb-4a74-b3ae-dc7fe0d23781 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.110791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58964-caeb-4a74-b3ae-dc7fe0d23781 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.111348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58964-caeb-4a74-b3ae-dc7fe0d23781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.142682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-dfa58964-caeb-4a74-b3ae-dc7fe0d23781 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:17.144874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-dfa58964-caeb-4a74-b3ae-dc7fe0d23781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:17.158671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:17.172590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:17.245771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 20/39] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:17.255199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bdd8c-2fa4-4092-9583-dfade6e196c6 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:17.272667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58964-caeb-4a74-b3ae-dc7fe0d23781 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:17.296848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:17.297487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.297777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.298062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.298772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:17.299117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:17.300531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:17.322671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 20/40] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:17.328905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:17.389914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58964-caeb-4a74-b3ae-dc7fe0d23781 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:17.427264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792600d1-cdfc-4978-84be-4d5b5ff038b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:17.427894 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792600d1-cdfc-4978-84be-4d5b5ff038b7 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.428180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792600d1-cdfc-4978-84be-4d5b5ff038b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.428455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792600d1-cdfc-4978-84be-4d5b5ff038b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.429181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792600d1-cdfc-4978-84be-4d5b5ff038b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:17.431306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792600d1-cdfc-4978-84be-4d5b5ff038b7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:17.442495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ca37c-2fba-4884-9e2a-196d3e093ed8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:17.457318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jul 26 07:38:17 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:38:17.457318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0afe4-7e8a-48f7-b64d-86ca50b0c4c7 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.457318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0afe4-7e8a-48f7-b64d-86ca50b0c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.457318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0afe4-7e8a-48f7-b64d-86ca50b0c4c7 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.457318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 22/42] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:17.457949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eed3b-7782-4a98-9e0b-d80fff62880f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.458248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eed3b-7782-4a98-9e0b-d80fff62880f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.458455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:17.458545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eed3b-7782-4a98-9e0b-d80fff62880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.501539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a12c60-3827-4274-b65e-a8bc411ca217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:17.501914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-285eed3b-7782-4a98-9e0b-d80fff62880f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:17.502239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a12c60-3827-4274-b65e-a8bc411ca217 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.502531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a12c60-3827-4274-b65e-a8bc411ca217 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.502818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a12c60-3827-4274-b65e-a8bc411ca217 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.503602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a12c60-3827-4274-b65e-a8bc411ca217 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:17.504056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-285eed3b-7782-4a98-9e0b-d80fff62880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:17.505196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a12c60-3827-4274-b65e-a8bc411ca217 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:17.516464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:17.559436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 21/43] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:38:17 2022] POST /identity/v3/projects => generated 301 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:17.597387 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 23/44] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:17.621774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a12c60-3827-4274-b65e-a8bc411ca217 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:17.747918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a12c60-3827-4274-b65e-a8bc411ca217 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:17.783083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bdda9-1db9-4331-9bb9-74aa8b60bfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:17.783737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bdda9-1db9-4331-9bb9-74aa8b60bfe6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.784021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bdda9-1db9-4331-9bb9-74aa8b60bfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.784299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bdda9-1db9-4331-9bb9-74aa8b60bfe6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.785452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bdda9-1db9-4331-9bb9-74aa8b60bfe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:17.786906 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bdda9-1db9-4331-9bb9-74aa8b60bfe6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:17.788535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 22/45] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:17.794749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eed3b-7782-4a98-9e0b-d80fff62880f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:17.893708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eed3b-7782-4a98-9e0b-d80fff62880f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:17.928234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8066e5-f81d-4473-961e-6be1447081d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:17.928861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8066e5-f81d-4473-961e-6be1447081d2 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:17.929148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8066e5-f81d-4473-961e-6be1447081d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:17.929430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8066e5-f81d-4473-961e-6be1447081d2 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:17.930114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8066e5-f81d-4473-961e-6be1447081d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:17.931605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8066e5-f81d-4473-961e-6be1447081d2 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:17.947999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:17.960333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:38:17 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:19.149715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c98375-66ab-4d11-80fb-8486b9df6812 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.150199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c98375-66ab-4d11-80fb-8486b9df6812 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.150280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c98375-66ab-4d11-80fb-8486b9df6812 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:19.151698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 23/47] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:19.156818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd331b-aff4-49cc-b7ef-2b3c171a7417 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.157258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd331b-aff4-49cc-b7ef-2b3c171a7417 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.157385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd331b-aff4-49cc-b7ef-2b3c171a7417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:19.175662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-39cd331b-aff4-49cc-b7ef-2b3c171a7417 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:19.176857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-39cd331b-aff4-49cc-b7ef-2b3c171a7417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:19.241693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:19.264319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c98375-66ab-4d11-80fb-8486b9df6812 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:19.292062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:19.366547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c98375-66ab-4d11-80fb-8486b9df6812 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:19.399174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6626-6445-4e37-a51e-36c27f004165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:19.399869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6626-6445-4e37-a51e-36c27f004165 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.400104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6626-6445-4e37-a51e-36c27f004165 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.400383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6626-6445-4e37-a51e-36c27f004165 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:19.412227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6626-6445-4e37-a51e-36c27f004165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-b6ea6626-6445-4e37-a51e-36c27f004165 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:19.417826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:19.418742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:19.419622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 24/49] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:19.424760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd331b-aff4-49cc-b7ef-2b3c171a7417 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:19.520819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd331b-aff4-49cc-b7ef-2b3c171a7417 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:19.547574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:19.556284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:19.556908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.557219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.557500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:19.558223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:19.558533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:19.559948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:19.571107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 26/50] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:19.576566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6626-6445-4e37-a51e-36c27f004165 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:19.659679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:19.675475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6626-6445-4e37-a51e-36c27f004165 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:19.708311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e486f-470e-447c-81e8-671cbef67411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:19.708952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e486f-470e-447c-81e8-671cbef67411 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.709236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e486f-470e-447c-81e8-671cbef67411 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.709511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e486f-470e-447c-81e8-671cbef67411 None admin] PATH_INFO: `/v3/users/312d9f01937f4f95a328912567973a43` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:19.710667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e486f-470e-447c-81e8-671cbef67411 None admin] RBAC: Authorizing `identity:get_user(user_id=312d9f01937f4f95a328912567973a43)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:19.712153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e486f-470e-447c-81e8-671cbef67411 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:19.714374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 25/51] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:19 2022] GET /identity/v3/users/312d9f01937f4f95a328912567973a43 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:19.719794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:19.820683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de31d6-89e0-493b-8018-fa38b3e58f3c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:19.854695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819d623-0c17-4e33-aaf3-a7e5fc392f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:19.855383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d623-0c17-4e33-aaf3-a7e5fc392f54 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.855672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d623-0c17-4e33-aaf3-a7e5fc392f54 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.855955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d623-0c17-4e33-aaf3-a7e5fc392f54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:19.857144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819d623-0c17-4e33-aaf3-a7e5fc392f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:19.858610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819d623-0c17-4e33-aaf3-a7e5fc392f54 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:19.860246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 27/52] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:19.866033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e486f-470e-447c-81e8-671cbef67411 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:19.940357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e7bc1-f6fe-4bba-b04f-11e5544fc4aa None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.940676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e7bc1-f6fe-4bba-b04f-11e5544fc4aa None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.940961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e7bc1-f6fe-4bba-b04f-11e5544fc4aa None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:19.942301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 28/53] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:19.947187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf314a-a661-4d64-b13d-4d86037505d1 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.947483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf314a-a661-4d64-b13d-4d86037505d1 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.948265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf314a-a661-4d64-b13d-4d86037505d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:19.965674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e486f-470e-447c-81e8-671cbef67411 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:19.966152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7edf314a-a661-4d64-b13d-4d86037505d1 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:19.967391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7edf314a-a661-4d64-b13d-4d86037505d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:19.998497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:19.999150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:19.999440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:19.999720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:20.000651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.domain.id=default, user.id=312d9f01937f4f95a328912567973a43) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:20.000966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:20.002400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:20.008105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 26/54] 10.222.0.46 () {56 vars in 1322 bytes} [Tue Jul 26 07:38:19 2022] GET /identity/v3/role_assignments?user.id=312d9f01937f4f95a328912567973a43&scope.domain.id=default&role.id=53894f3146884908ba6dd3e118397fb3 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:20.017395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:20.037193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 29/55] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:20.060760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:20.081741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:20.168836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11b122-18a6-4fe1-87c8-6cb294da4da2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:20.203305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fe845-0371-4822-87a1-39128ad57095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:20.203900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe845-0371-4822-87a1-39128ad57095 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:20.204190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe845-0371-4822-87a1-39128ad57095 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:20.204467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fe845-0371-4822-87a1-39128ad57095 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:20.205643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fe845-0371-4822-87a1-39128ad57095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:20.207148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fe845-0371-4822-87a1-39128ad57095 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:20.208755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 27/56] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:20.214508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf314a-a661-4d64-b13d-4d86037505d1 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:20.309181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf314a-a661-4d64-b13d-4d86037505d1 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:20.342517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2eaa43-0a83-4532-a056-18cb7d3fdf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:20.343190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eaa43-0a83-4532-a056-18cb7d3fdf72 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:20.343478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eaa43-0a83-4532-a056-18cb7d3fdf72 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:20.343757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2eaa43-0a83-4532-a056-18cb7d3fdf72 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:20.344444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2eaa43-0a83-4532-a056-18cb7d3fdf72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:20.345897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2eaa43-0a83-4532-a056-18cb7d3fdf72 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:20.371084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 30/57] 10.222.0.46 () {60 vars in 1140 bytes} [Tue Jul 26 07:38:20 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:22.322367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177dac-3600-403a-b115-8041909983b8 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:22.323446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177dac-3600-403a-b115-8041909983b8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:22.323567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177dac-3600-403a-b115-8041909983b8 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:22.324933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 28/58] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:22.330512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb29c1-5e80-422b-ae1b-0d81f47c32eb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:22.330902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb29c1-5e80-422b-ae1b-0d81f47c32eb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:22.331108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb29c1-5e80-422b-ae1b-0d81f47c32eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:22.348701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8eeb29c1-5e80-422b-ae1b-0d81f47c32eb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:22.349888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8eeb29c1-5e80-422b-ae1b-0d81f47c32eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:22.378421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:22.416315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 31/59] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:22.440245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177dac-3600-403a-b115-8041909983b8 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:22.523814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:22.540770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177dac-3600-403a-b115-8041909983b8 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:22.575722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c655-aa41-4214-93c1-1ee573b9467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:22.576302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c655-aa41-4214-93c1-1ee573b9467d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:22.576591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c655-aa41-4214-93c1-1ee573b9467d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:22.576876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c655-aa41-4214-93c1-1ee573b9467d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:22.578034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5c655-aa41-4214-93c1-1ee573b9467d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:22.579546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5c655-aa41-4214-93c1-1ee573b9467d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:22.581141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 29/60] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:22.586565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb29c1-5e80-422b-ae1b-0d81f47c32eb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:22.681966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb29c1-5e80-422b-ae1b-0d81f47c32eb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:22.716225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b99671-f382-4c91-b9c3-0ec8277ac2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:22.716837 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99671-f382-4c91-b9c3-0ec8277ac2d2 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:22.717119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99671-f382-4c91-b9c3-0ec8277ac2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:22.717394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b99671-f382-4c91-b9c3-0ec8277ac2d2 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:22.718081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b99671-f382-4c91-b9c3-0ec8277ac2d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:22.719561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b99671-f382-4c91-b9c3-0ec8277ac2d2 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:22.744230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 32/61] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:38:22 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:25.649001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9355-8c63-4aec-921a-13ef4681846b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:25.649851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9355-8c63-4aec-921a-13ef4681846b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:25.650302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe9355-8c63-4aec-921a-13ef4681846b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:25.652118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 30/62] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:25.657312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7da1b-cf5d-48cb-bd2b-99531e1f87c3 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:25.657713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7da1b-cf5d-48cb-bd2b-99531e1f87c3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:25.658067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7da1b-cf5d-48cb-bd2b-99531e1f87c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:25.687981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7ca7da1b-cf5d-48cb-bd2b-99531e1f87c3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:25.689239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7ca7da1b-cf5d-48cb-bd2b-99531e1f87c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:25.709858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:25.774614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 33/63] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:25.820438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe9355-8c63-4aec-921a-13ef4681846b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:25.902791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8d1a1-075d-44b1-a001-3e9bae8620bb None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:25.903437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8d1a1-075d-44b1-a001-3e9bae8620bb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:25.903919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8d1a1-075d-44b1-a001-3e9bae8620bb None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:25.905843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 34/64] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:25.915385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d787-4f61-4821-9404-a73119ce7603 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:25.915945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d787-4f61-4821-9404-a73119ce7603 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:25.916954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d787-4f61-4821-9404-a73119ce7603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:25.947896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe9355-8c63-4aec-921a-13ef4681846b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:25.959804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5c75d787-4f61-4821-9404-a73119ce7603 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:25.961024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5c75d787-4f61-4821-9404-a73119ce7603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:25.996167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64351b0e-3214-4946-a681-2ff4261ad2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:25.997064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64351b0e-3214-4946-a681-2ff4261ad2b2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:25.997594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64351b0e-3214-4946-a681-2ff4261ad2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:25.998014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64351b0e-3214-4946-a681-2ff4261ad2b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.008790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64351b0e-3214-4946-a681-2ff4261ad2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-64351b0e-3214-4946-a681-2ff4261ad2b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:26.014484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:26.015514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:26.016427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:26.018608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 31/65] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:26.043971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64351b0e-3214-4946-a681-2ff4261ad2b2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:26.072524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 35/66] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:26.084437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d561171-5d23-4c78-a14e-116774a261f8 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.084780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d561171-5d23-4c78-a14e-116774a261f8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.085009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d561171-5d23-4c78-a14e-116774a261f8 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.086474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 36/67] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:26.087310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:26.096695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d561171-5d23-4c78-a14e-116774a261f8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:26.171540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64351b0e-3214-4946-a681-2ff4261ad2b2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:26.207039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4633d6-9ff2-4819-a697-2633832f90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:26.207996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4633d6-9ff2-4819-a697-2633832f90a8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.208422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4633d6-9ff2-4819-a697-2633832f90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.208880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4633d6-9ff2-4819-a697-2633832f90a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.209744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4633d6-9ff2-4819-a697-2633832f90a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:26.210196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4633d6-9ff2-4819-a697-2633832f90a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:26.211821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4633d6-9ff2-4819-a697-2633832f90a8 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:26.216728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:26.221691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 32/68] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:26.223282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151ff15-8d4e-4687-a1b6-3be541ce7ae9 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.223777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151ff15-8d4e-4687-a1b6-3be541ce7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.224271 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151ff15-8d4e-4687-a1b6-3be541ce7ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.237494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d561171-5d23-4c78-a14e-116774a261f8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:26.245129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f151ff15-8d4e-4687-a1b6-3be541ce7ae9 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:26.246748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f151ff15-8d4e-4687-a1b6-3be541ce7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:26.278902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f581d-55b6-4268-92a1-3d629f186073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:26.279955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f581d-55b6-4268-92a1-3d629f186073 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.280437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f581d-55b6-4268-92a1-3d629f186073 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.280908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f581d-55b6-4268-92a1-3d629f186073 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.294281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f581d-55b6-4268-92a1-3d629f186073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-fb3f581d-55b6-4268-92a1-3d629f186073 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:26.299675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:26.300535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:26.301284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:26.303608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 37/69] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:26.309620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f581d-55b6-4268-92a1-3d629f186073 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:26.329521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 33/70] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:26.330683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151ff15-8d4e-4687-a1b6-3be541ce7ae9 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:26.339537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:26.436718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151ff15-8d4e-4687-a1b6-3be541ce7ae9 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:26.443150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f581d-55b6-4268-92a1-3d629f186073 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:26.472575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:26.473261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.473565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.473873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.474599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:26.474908 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:26.476320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:26.480494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03951665-6fd1-4479-be6c-50dfc4f18e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:26.481146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951665-6fd1-4479-be6c-50dfc4f18e7e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.481435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951665-6fd1-4479-be6c-50dfc4f18e7e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.481717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03951665-6fd1-4479-be6c-50dfc4f18e7e None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.486211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 34/71] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:26.490895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:26.498777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03951665-6fd1-4479-be6c-50dfc4f18e7e None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:26.500291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03951665-6fd1-4479-be6c-50dfc4f18e7e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:26.502098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 38/72] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:26.503328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c493e-7900-4a59-82ec-1c7be14671a8 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.503622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c493e-7900-4a59-82ec-1c7be14671a8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.503908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c493e-7900-4a59-82ec-1c7be14671a8 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.509270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 39/73] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:26.509985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c493e-7900-4a59-82ec-1c7be14671a8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:26.513051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:26.572446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:26.606916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56708c0-744e-4696-82ba-1440bc5a7fee None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:26.614340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c493e-7900-4a59-82ec-1c7be14671a8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:26.641801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5f2d5-2536-4da7-a527-4791873a4c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:26.642464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f2d5-2536-4da7-a527-4791873a4c93 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.642754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f2d5-2536-4da7-a527-4791873a4c93 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.643068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f2d5-2536-4da7-a527-4791873a4c93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.649048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b175a-e156-418d-ad43-fbb50a2ef4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:26.649699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b175a-e156-418d-ad43-fbb50a2ef4bb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.650072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b175a-e156-418d-ad43-fbb50a2ef4bb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.650262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b175a-e156-418d-ad43-fbb50a2ef4bb None admin] PATH_INFO: `/v3/users/312d9f01937f4f95a328912567973a43` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.651561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b175a-e156-418d-ad43-fbb50a2ef4bb None admin] RBAC: Authorizing `identity:get_user(user_id=312d9f01937f4f95a328912567973a43)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:26.653043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b175a-e156-418d-ad43-fbb50a2ef4bb None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:26.654175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5f2d5-2536-4da7-a527-4791873a4c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:26.654869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 40/74] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/users/312d9f01937f4f95a328912567973a43 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-efe5f2d5-2536-4da7-a527-4791873a4c93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:26.659663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:26.660598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:26.666051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:26.667156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b175a-e156-418d-ad43-fbb50a2ef4bb None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:26.667545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 35/75] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:26.667545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291650e-0d12-4175-825a-82037f375a56 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.667545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291650e-0d12-4175-825a-82037f375a56 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.667545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291650e-0d12-4175-825a-82037f375a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.681199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8291650e-0d12-4175-825a-82037f375a56 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:26.683015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8291650e-0d12-4175-825a-82037f375a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:26.742821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:26.752062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 36/76] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:26.753328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56701-6509-4fc6-996e-4c2b7053e896 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.753620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56701-6509-4fc6-996e-4c2b7053e896 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.753899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56701-6509-4fc6-996e-4c2b7053e896 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.755349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 37/77] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:26.755878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56701-6509-4fc6-996e-4c2b7053e896 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:26.784405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b175a-e156-418d-ad43-fbb50a2ef4bb None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:26.817813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:26.819534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89cb1a-071d-422b-bfad-443fb8135aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:26.820213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89cb1a-071d-422b-bfad-443fb8135aab None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.820498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89cb1a-071d-422b-bfad-443fb8135aab None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.820778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89cb1a-071d-422b-bfad-443fb8135aab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.863683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56701-6509-4fc6-996e-4c2b7053e896 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:26.890678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89cb1a-071d-422b-bfad-443fb8135aab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:26.892255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89cb1a-071d-422b-bfad-443fb8135aab None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:26.899126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3ec31-8688-403e-b03f-bede8e606351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:26.899748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3ec31-8688-403e-b03f-bede8e606351 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:26.900045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3ec31-8688-403e-b03f-bede8e606351 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:26.900323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3ec31-8688-403e-b03f-bede8e606351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:26.959565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:26.968681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3ec31-8688-403e-b03f-bede8e606351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:26.970181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3ec31-8688-403e-b03f-bede8e606351 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:26.991470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 41/78] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:26.992235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89cb1a-071d-422b-bfad-443fb8135aab None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.027882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:27.070321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 38/79] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:27.071612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7444cd-f35a-4a4a-864b-60216b87827b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.072083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7444cd-f35a-4a4a-864b-60216b87827b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.072491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7444cd-f35a-4a4a-864b-60216b87827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.090732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-fe7444cd-f35a-4a4a-864b-60216b87827b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:27.091981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fe7444cd-f35a-4a4a-864b-60216b87827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:27.093196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89cb1a-071d-422b-bfad-443fb8135aab None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.126778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.127436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.127724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.128006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.128726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:27.129036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.130427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:27.138784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 42/80] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:38:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:27.139625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.162572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 39/81] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:27.168411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7444cd-f35a-4a4a-864b-60216b87827b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.170170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:27.242603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea36a-7fcc-4b8f-8672-44609ede3698 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.258313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:27.271095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7444cd-f35a-4a4a-864b-60216b87827b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.276291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141b646-0b55-4a8f-8ab5-79fa6bd6cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.276942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141b646-0b55-4a8f-8ab5-79fa6bd6cc93 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.277230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141b646-0b55-4a8f-8ab5-79fa6bd6cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.277513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141b646-0b55-4a8f-8ab5-79fa6bd6cc93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.287567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141b646-0b55-4a8f-8ab5-79fa6bd6cc93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-d141b646-0b55-4a8f-8ab5-79fa6bd6cc93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:27.293543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:27.294366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:27.295165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 43/82] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:27.295791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141b646-0b55-4a8f-8ab5-79fa6bd6cc93 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.308915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913301-210b-4a34-a907-92d3326bac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.309575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913301-210b-4a34-a907-92d3326bac63 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.309860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913301-210b-4a34-a907-92d3326bac63 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.310135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913301-210b-4a34-a907-92d3326bac63 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.311333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7913301-210b-4a34-a907-92d3326bac63 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.312872 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7913301-210b-4a34-a907-92d3326bac63 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:27.314534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 40/83] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:27.319336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913301-210b-4a34-a907-92d3326bac63 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.389763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:27.398999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141b646-0b55-4a8f-8ab5-79fa6bd6cc93 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.413179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913301-210b-4a34-a907-92d3326bac63 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.431926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5e2e-841a-47a3-84ca-6b6dd16d20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.433086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5e2e-841a-47a3-84ca-6b6dd16d20c3 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.433375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5e2e-841a-47a3-84ca-6b6dd16d20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.433651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5e2e-841a-47a3-84ca-6b6dd16d20c3 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.434821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed5e2e-841a-47a3-84ca-6b6dd16d20c3 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.436309 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed5e2e-841a-47a3-84ca-6b6dd16d20c3 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:27.437981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 44/84] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:27.438748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5e2e-841a-47a3-84ca-6b6dd16d20c3 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.451080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac57503-b623-4b51-80db-b4465dc5f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.451723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57503-b623-4b51-80db-b4465dc5f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.452004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57503-b623-4b51-80db-b4465dc5f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.452279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57503-b623-4b51-80db-b4465dc5f3a6 None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.453525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac57503-b623-4b51-80db-b4465dc5f3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.455007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac57503-b623-4b51-80db-b4465dc5f3a6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:27.456597 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 41/85] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:27.457349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac57503-b623-4b51-80db-b4465dc5f3a6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.481516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:27.545269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5e2e-841a-47a3-84ca-6b6dd16d20c3 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.554185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac57503-b623-4b51-80db-b4465dc5f3a6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.578143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9154bc9-64af-4d25-8dc8-4618f17bc072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.578862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154bc9-64af-4d25-8dc8-4618f17bc072 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.579186 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154bc9-64af-4d25-8dc8-4618f17bc072 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.579461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154bc9-64af-4d25-8dc8-4618f17bc072 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.580613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9154bc9-64af-4d25-8dc8-4618f17bc072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.582072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9154bc9-64af-4d25-8dc8-4618f17bc072 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:27.583685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 45/86] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:27.584529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9154bc9-64af-4d25-8dc8-4618f17bc072 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.590093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.590719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.591043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.591328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.592057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:27.592368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.593759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:27.602080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 42/87] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:27.602888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.612849 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:27.683434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9154bc9-64af-4d25-8dc8-4618f17bc072 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.689061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:27.705543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a78870-7742-4c20-b77d-43299aeae366 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.716838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.717463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.717749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.718032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.718826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] RBAC: Adding query filter params (role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa, user.id=c7c7587f428b4eecaea47868f0004d3f) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:27.719175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.720617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:27.727976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 46/88] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/role_assignments?user.id=c7c7587f428b4eecaea47868f0004d3f&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:27.728787 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.744037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.744988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.745443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.745859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.746817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa, user.id=312d9f01937f4f95a328912567973a43) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:27.747319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.748963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:27.756037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 43/89] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/role_assignments?user.id=312d9f01937f4f95a328912567973a43&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=53894f3146884908ba6dd3e118397fb3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:27.757185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:27.887344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:27.902772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333085a8-908d-46b8-9ab8-6510c39c1847 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.930568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152122d-507a-415a-99cf-0d69257e5d0b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:27.946110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b76fd7-835f-473c-a3e4-0c671f679538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.946744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b76fd7-835f-473c-a3e4-0c671f679538 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.947117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b76fd7-835f-473c-a3e4-0c671f679538 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.947397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b76fd7-835f-473c-a3e4-0c671f679538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.976168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de9a5-8e78-4ad7-a17a-583d6cbcced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:27.976797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de9a5-8e78-4ad7-a17a-583d6cbcced5 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:27.977080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de9a5-8e78-4ad7-a17a-583d6cbcced5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:27.977357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de9a5-8e78-4ad7-a17a-583d6cbcced5 None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:27.978047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102de9a5-8e78-4ad7-a17a-583d6cbcced5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:27.979667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102de9a5-8e78-4ad7-a17a-583d6cbcced5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:28.010581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 44/90] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:38:27 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:28.016098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de9a5-8e78-4ad7-a17a-583d6cbcced5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:28.033965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:28.038194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b76fd7-835f-473c-a3e4-0c671f679538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:28.040796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b76fd7-835f-473c-a3e4-0c671f679538 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:28.173232 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de9a5-8e78-4ad7-a17a-583d6cbcced5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:28.186173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:28.206607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 47/91] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:28.207882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b76fd7-835f-473c-a3e4-0c671f679538 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:28.217142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40573749-bae0-44a6-8be8-789749e2c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:28.217493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573749-bae0-44a6-8be8-789749e2c13d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:28.217827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573749-bae0-44a6-8be8-789749e2c13d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:28.218111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573749-bae0-44a6-8be8-789749e2c13d None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:28.219651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40573749-bae0-44a6-8be8-789749e2c13d None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:28.222667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40573749-bae0-44a6-8be8-789749e2c13d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:28.224861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 45/92] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:28 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:28.235718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40573749-bae0-44a6-8be8-789749e2c13d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:28.327411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b76fd7-835f-473c-a3e4-0c671f679538 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:28.371961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dc520-6877-4472-a349-1c4a360aef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:28.372946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc520-6877-4472-a349-1c4a360aef9b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:28.373422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc520-6877-4472-a349-1c4a360aef9b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:28.373888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc520-6877-4472-a349-1c4a360aef9b None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:28.375346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dc520-6877-4472-a349-1c4a360aef9b None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:28.377063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dc520-6877-4472-a349-1c4a360aef9b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:28.378917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 48/93] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:28 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:28.385692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:28.391912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dc520-6877-4472-a349-1c4a360aef9b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:28.399645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40573749-bae0-44a6-8be8-789749e2c13d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:28.446128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc899c-a663-477f-a72b-23d8540224c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:28.447209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc899c-a663-477f-a72b-23d8540224c0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:28.448258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc899c-a663-477f-a72b-23d8540224c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:28.448736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc899c-a663-477f-a72b-23d8540224c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:28.484312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:28.542519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dc520-6877-4472-a349-1c4a360aef9b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:28.551262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc899c-a663-477f-a72b-23d8540224c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:28.555784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc899c-a663-477f-a72b-23d8540224c0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:28.585671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:28.586297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:28.586585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:28.586861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:28.587691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] RBAC: Adding query filter params (role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa, user.id=c7c7587f428b4eecaea47868f0004d3f) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:28.588003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:28.591034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:28.598307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 49/94] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:28 2022] GET /identity/v3/role_assignments?user.id=c7c7587f428b4eecaea47868f0004d3f&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:28.679316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:28.698993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 46/95] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:28.706006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:28.831224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbbd12-b8bb-4d16-bfe5-a8bb41e51d55 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:28.860428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:28.876560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2b67d-c556-4b91-88e9-e399db1e26ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:28.877556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b67d-c556-4b91-88e9-e399db1e26ae None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:28.878034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b67d-c556-4b91-88e9-e399db1e26ae None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:28.878593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b67d-c556-4b91-88e9-e399db1e26ae None admin] PATH_INFO: `/v3/projects/64a9e130106d4b488035ba02efb493ce` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:28.880056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b67d-c556-4b91-88e9-e399db1e26ae None admin] RBAC: Authorizing `identity:get_project(project_id=64a9e130106d4b488035ba02efb493ce)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:28.881705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b67d-c556-4b91-88e9-e399db1e26ae None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:28.888125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 50/96] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:28 2022] GET /identity/v3/projects/64a9e130106d4b488035ba02efb493ce => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:28.894116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc899c-a663-477f-a72b-23d8540224c0 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:29.024851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc899c-a663-477f-a72b-23d8540224c0 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:29.064547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1cac0-c2d4-4208-b9fa-dcc019b59fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:29.065186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cac0-c2d4-4208-b9fa-dcc019b59fee None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:29.065471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cac0-c2d4-4208-b9fa-dcc019b59fee None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:29.065748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1cac0-c2d4-4208-b9fa-dcc019b59fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:29.066552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1cac0-c2d4-4208-b9fa-dcc019b59fee None admin] RBAC: Adding query filter params (role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=64a9e130106d4b488035ba02efb493ce, user.id=c7c7587f428b4eecaea47868f0004d3f) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:29.066866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1cac0-c2d4-4208-b9fa-dcc019b59fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:29.068358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1cac0-c2d4-4208-b9fa-dcc019b59fee None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:29.074653 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 47/97] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:28 2022] GET /identity/v3/role_assignments?user.id=c7c7587f428b4eecaea47868f0004d3f&scope.project.id=64a9e130106d4b488035ba02efb493ce&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:30.079221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bdbf3-f2fc-4a96-b802-4c1749b6cb66 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:30.080189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bdbf3-f2fc-4a96-b802-4c1749b6cb66 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:30.080676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bdbf3-f2fc-4a96-b802-4c1749b6cb66 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:30.082223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 51/98] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:30.098780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b913-d609-4f88-a0bb-b4ea3538b60e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:30.099717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b913-d609-4f88-a0bb-b4ea3538b60e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:30.100189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2b913-d609-4f88-a0bb-b4ea3538b60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:30.122206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b3d2b913-d609-4f88-a0bb-b4ea3538b60e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:30.123728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b3d2b913-d609-4f88-a0bb-b4ea3538b60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:30.157495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:30.198063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2481d-3f1b-420c-aae8-7bf17fc5b5a9 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:30.198351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2481d-3f1b-420c-aae8-7bf17fc5b5a9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:30.198630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2481d-3f1b-420c-aae8-7bf17fc5b5a9 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:30.200002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 52/99] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:30.208255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 48/100] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:30.216442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a4c9-b2d2-42f0-99f2-6d4c59a399a9 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:30.216735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a4c9-b2d2-42f0-99f2-6d4c59a399a9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:30.217019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a4c9-b2d2-42f0-99f2-6d4c59a399a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:30.239947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8fd5a4c9-b2d2-42f0-99f2-6d4c59a399a9 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:30.241147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8fd5a4c9-b2d2-42f0-99f2-6d4c59a399a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:30.277863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2b913-d609-4f88-a0bb-b4ea3538b60e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:30.364594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 53/101] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:30.387819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a4c9-b2d2-42f0-99f2-6d4c59a399a9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:30.467395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2b913-d609-4f88-a0bb-b4ea3538b60e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:30.508381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a4c9-b2d2-42f0-99f2-6d4c59a399a9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:30.527268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b7057-add6-4f79-9e97-bdde33a118d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:30.528781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b7057-add6-4f79-9e97-bdde33a118d6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:30.529455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b7057-add6-4f79-9e97-bdde33a118d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:30.530132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b7057-add6-4f79-9e97-bdde33a118d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:30.549676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b7057-add6-4f79-9e97-bdde33a118d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-766b7057-add6-4f79-9e97-bdde33a118d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:30.554987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:30.555815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:30.556641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:30.560703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:30.561448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 49/102] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:30.568016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b7057-add6-4f79-9e97-bdde33a118d6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:30.585293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde28156-ffd1-4ede-87b0-7d22ea4ab80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:30.585960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28156-ffd1-4ede-87b0-7d22ea4ab80b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:30.586250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28156-ffd1-4ede-87b0-7d22ea4ab80b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:30.586532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28156-ffd1-4ede-87b0-7d22ea4ab80b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:30.609115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde28156-ffd1-4ede-87b0-7d22ea4ab80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-cde28156-ffd1-4ede-87b0-7d22ea4ab80b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:30.614229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:30.615147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:30.616314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 54/103] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:30.621789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde28156-ffd1-4ede-87b0-7d22ea4ab80b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:30.631791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:30.777095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b7057-add6-4f79-9e97-bdde33a118d6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:30.819081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde28156-ffd1-4ede-87b0-7d22ea4ab80b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:30.891160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:30.891850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:30.892145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:30.892245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:30.892449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:30.892822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:30.893113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:30.893211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:30.893388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:30.893493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:30.894121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:30.894433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:30.895134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:30.896133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:30.904612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 55/104] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:30.910287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:30.917321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 50/105] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:30.924149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:30.988731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:31.047922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:31.065207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f3ba6-0137-4e43-9214-17c8331b5700 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:31.090433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aca0f-df97-4736-931c-e5756e73e7b5 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:31.127529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b544ce0-f48e-4495-9e8f-c34ccfe4841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:31.128194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b544ce0-f48e-4495-9e8f-c34ccfe4841d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.128486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b544ce0-f48e-4495-9e8f-c34ccfe4841d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.128769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b544ce0-f48e-4495-9e8f-c34ccfe4841d None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.130275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b544ce0-f48e-4495-9e8f-c34ccfe4841d None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:31.132049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b544ce0-f48e-4495-9e8f-c34ccfe4841d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:31.139526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 51/106] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:30 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:31.151324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b544ce0-f48e-4495-9e8f-c34ccfe4841d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:31.157758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43fd6e-8fb8-4820-a244-366dd6481951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:31.158727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43fd6e-8fb8-4820-a244-366dd6481951 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.159247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43fd6e-8fb8-4820-a244-366dd6481951 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.159794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43fd6e-8fb8-4820-a244-366dd6481951 None admin] PATH_INFO: `/v3/users/312d9f01937f4f95a328912567973a43` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.163713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43fd6e-8fb8-4820-a244-366dd6481951 None admin] RBAC: Authorizing `identity:get_user(user_id=312d9f01937f4f95a328912567973a43)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:31.165410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43fd6e-8fb8-4820-a244-366dd6481951 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:31.167858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 56/107] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:30 2022] GET /identity/v3/users/312d9f01937f4f95a328912567973a43 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:31.178138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43fd6e-8fb8-4820-a244-366dd6481951 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:31.355361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b544ce0-f48e-4495-9e8f-c34ccfe4841d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:31.367237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43fd6e-8fb8-4820-a244-366dd6481951 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:31.392244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:31.424514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdbb03-21a5-433b-8c7e-df7136d2a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:31.425109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbb03-21a5-433b-8c7e-df7136d2a27f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.425398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbb03-21a5-433b-8c7e-df7136d2a27f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.425683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdbb03-21a5-433b-8c7e-df7136d2a27f None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.427065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdbb03-21a5-433b-8c7e-df7136d2a27f None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:31.428963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdbb03-21a5-433b-8c7e-df7136d2a27f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:31.437902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 52/108] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:31 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:31.439054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdbb03-21a5-433b-8c7e-df7136d2a27f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:31.442615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8fb9-8a8e-4903-a22d-312901554c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:31.443563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8fb9-8a8e-4903-a22d-312901554c4e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.444046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8fb9-8a8e-4903-a22d-312901554c4e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.444518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8fb9-8a8e-4903-a22d-312901554c4e None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.445913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d8fb9-8a8e-4903-a22d-312901554c4e None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:31.447731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d8fb9-8a8e-4903-a22d-312901554c4e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:31.450057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 57/109] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:31 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:31.460401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8fb9-8a8e-4903-a22d-312901554c4e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:31.486845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:31.598939 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdbb03-21a5-433b-8c7e-df7136d2a27f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:31.621326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8fb9-8a8e-4903-a22d-312901554c4e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:31.638485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c735-8d1c-46c7-9d5a-f103686452dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:31.639437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c735-8d1c-46c7-9d5a-f103686452dd None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.640113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c735-8d1c-46c7-9d5a-f103686452dd None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.640403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c735-8d1c-46c7-9d5a-f103686452dd None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/users/c7c7587f428b4eecaea47868f0004d3f/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.642446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99c735-8d1c-46c7-9d5a-f103686452dd None admin] RBAC: Authorizing `identity:create_grant(project_id=270803d5e32745d7be36c6fe3ecd55aa, user_id=c7c7587f428b4eecaea47868f0004d3f, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:31.644737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99c735-8d1c-46c7-9d5a-f103686452dd None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:31.659377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f37c1-c935-4a84-b501-8f4362ce5d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:31.660283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f37c1-c935-4a84-b501-8f4362ce5d6a None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.660834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f37c1-c935-4a84-b501-8f4362ce5d6a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.661232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f37c1-c935-4a84-b501-8f4362ce5d6a None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/users/312d9f01937f4f95a328912567973a43/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.663279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 53/110] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:31 2022] PUT /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/users/c7c7587f428b4eecaea47868f0004d3f/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:31.663438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f37c1-c935-4a84-b501-8f4362ce5d6a None admin] RBAC: Authorizing `identity:create_grant(project_id=270803d5e32745d7be36c6fe3ecd55aa, user_id=312d9f01937f4f95a328912567973a43, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:31.664353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691522e6-a136-4ea8-9b69-98021fed10b8 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.664709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691522e6-a136-4ea8-9b69-98021fed10b8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.665105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691522e6-a136-4ea8-9b69-98021fed10b8 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.665350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f37c1-c935-4a84-b501-8f4362ce5d6a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:31.667073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 54/111] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:31.668163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934e443-de25-4334-9192-b62bc7141a8c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.668453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934e443-de25-4334-9192-b62bc7141a8c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.668733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934e443-de25-4334-9192-b62bc7141a8c None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.670398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 55/112] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:31.677020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10f69-414c-4070-a5e1-af2fae17ee3d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.677243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10f69-414c-4070-a5e1-af2fae17ee3d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.677757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10f69-414c-4070-a5e1-af2fae17ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.689051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 58/113] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:31 2022] PUT /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/users/312d9f01937f4f95a328912567973a43/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:31.690268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458473c-4405-4776-ad90-c57ad2b3789d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.695444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458473c-4405-4776-ad90-c57ad2b3789d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.695754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458473c-4405-4776-ad90-c57ad2b3789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.701480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-71f10f69-414c-4070-a5e1-af2fae17ee3d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:31.702994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-71f10f69-414c-4070-a5e1-af2fae17ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:31.752193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7458473c-4405-4776-ad90-c57ad2b3789d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:31.753487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7458473c-4405-4776-ad90-c57ad2b3789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:31.794958 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 56/114] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:31.821454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10f69-414c-4070-a5e1-af2fae17ee3d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:31.851445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:31.886399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:31.944399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10f69-414c-4070-a5e1-af2fae17ee3d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:31.969692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 59/115] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:31.971033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf3ae-0356-41e4-a918-0a59c4584de8 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.971334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf3ae-0356-41e4-a918-0a59c4584de8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.971620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcf3ae-0356-41e4-a918-0a59c4584de8 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.977871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 60/116] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:31.979545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884577d-49b0-4531-8c09-48e54d986583 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.979849 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884577d-49b0-4531-8c09-48e54d986583 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.980138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884577d-49b0-4531-8c09-48e54d986583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.991646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d5d44-01bc-47af-8fff-ddf9e61a1f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:31.992319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d5d44-01bc-47af-8fff-ddf9e61a1f2e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:31.992604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d5d44-01bc-47af-8fff-ddf9e61a1f2e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:31.992882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d5d44-01bc-47af-8fff-ddf9e61a1f2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:31.994109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d5d44-01bc-47af-8fff-ddf9e61a1f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:31.995665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d5d44-01bc-47af-8fff-ddf9e61a1f2e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:31.997535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 57/117] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:31.999274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-2884577d-49b0-4531-8c09-48e54d986583 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:32.000546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2884577d-49b0-4531-8c09-48e54d986583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:32.002729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d5d44-01bc-47af-8fff-ddf9e61a1f2e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:32.078317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 61/118] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:32.079737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884577d-49b0-4531-8c09-48e54d986583 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:32.108485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:32.121702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d5d44-01bc-47af-8fff-ddf9e61a1f2e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:32.185621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437ef7b-6477-41fb-8be5-251f0839050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:32.186915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437ef7b-6477-41fb-8be5-251f0839050f None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.187475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437ef7b-6477-41fb-8be5-251f0839050f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.187900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437ef7b-6477-41fb-8be5-251f0839050f None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.188878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437ef7b-6477-41fb-8be5-251f0839050f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:32.190482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437ef7b-6477-41fb-8be5-251f0839050f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:32.219653 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 58/119] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:38:32 2022] POST /identity/v3/projects => generated 302 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:38:32.220964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437ef7b-6477-41fb-8be5-251f0839050f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:32.319153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:32.334414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884577d-49b0-4531-8c09-48e54d986583 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:32.340651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437ef7b-6477-41fb-8be5-251f0839050f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:32.379064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c578c7-757e-4e11-b58b-02ffda9ce13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:32.380299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c578c7-757e-4e11-b58b-02ffda9ce13b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.380792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c578c7-757e-4e11-b58b-02ffda9ce13b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.381305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c578c7-757e-4e11-b58b-02ffda9ce13b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.391330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:32.395640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c578c7-757e-4e11-b58b-02ffda9ce13b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-f3c578c7-757e-4e11-b58b-02ffda9ce13b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:32.402187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:32.403116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:32.403919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:32.406375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 59/120] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:38:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:32.412676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c578c7-757e-4e11-b58b-02ffda9ce13b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:32.467722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380aa7-18d5-4833-86db-8a6b595bc4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:32.468404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380aa7-18d5-4833-86db-8a6b595bc4fa None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.468690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380aa7-18d5-4833-86db-8a6b595bc4fa None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.468966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380aa7-18d5-4833-86db-8a6b595bc4fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.504264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e380aa7-18d5-4833-86db-8a6b595bc4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-7e380aa7-18d5-4833-86db-8a6b595bc4fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:32.509238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:32.510135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:32.510879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:32.515393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 62/121] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:32.516184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380aa7-18d5-4833-86db-8a6b595bc4fa None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:32.545800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c578c7-757e-4e11-b58b-02ffda9ce13b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:32.589406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df862-267f-423b-aeb1-e222a007d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:32.590553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df862-267f-423b-aeb1-e222a007d48e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.591293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df862-267f-423b-aeb1-e222a007d48e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.592205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df862-267f-423b-aeb1-e222a007d48e None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.593431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2df862-267f-423b-aeb1-e222a007d48e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:32.594189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2df862-267f-423b-aeb1-e222a007d48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:32.596508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2df862-267f-423b-aeb1-e222a007d48e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:32.608725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 60/122] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:38:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:32.610995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8b93-589a-4a21-9eca-fff0182f1059 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.611501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8b93-589a-4a21-9eca-fff0182f1059 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.611980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8b93-589a-4a21-9eca-fff0182f1059 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.614050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 61/123] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:32.616520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8b93-589a-4a21-9eca-fff0182f1059 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:32.645760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380aa7-18d5-4833-86db-8a6b595bc4fa None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:32.691119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938aea9d-e459-4e19-888e-071a91019d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:32.692256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aea9d-e459-4e19-888e-071a91019d58 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.693045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aea9d-e459-4e19-888e-071a91019d58 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.693816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aea9d-e459-4e19-888e-071a91019d58 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.694747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938aea9d-e459-4e19-888e-071a91019d58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:32.695271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938aea9d-e459-4e19-888e-071a91019d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:32.697560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938aea9d-e459-4e19-888e-071a91019d58 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:32.708434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 63/124] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:32.710373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e65e-f92a-47dd-b6d3-57d3d8e2d50a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.710884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e65e-f92a-47dd-b6d3-57d3d8e2d50a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.711277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:32.711603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e65e-f92a-47dd-b6d3-57d3d8e2d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.734342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a337e65e-f92a-47dd-b6d3-57d3d8e2d50a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:32.735896 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a337e65e-f92a-47dd-b6d3-57d3d8e2d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:32.736789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8b93-589a-4a21-9eca-fff0182f1059 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:32.758159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:32.779961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71d06-7b08-499d-8bb8-3761aa076f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:32.781842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71d06-7b08-499d-8bb8-3761aa076f81 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.782353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71d06-7b08-499d-8bb8-3761aa076f81 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.782856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71d06-7b08-499d-8bb8-3761aa076f81 None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.784431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71d06-7b08-499d-8bb8-3761aa076f81 None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:32.786650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71d06-7b08-499d-8bb8-3761aa076f81 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:32.789025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 62/125] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:32 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:32.790879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71d06-7b08-499d-8bb8-3761aa076f81 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:32.814265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 64/126] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:32.815133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337e65e-f92a-47dd-b6d3-57d3d8e2d50a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:32.924537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71d06-7b08-499d-8bb8-3761aa076f81 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:32.952319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:32.969105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a6c31-3296-4330-88c0-31e0763127f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:32.971390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6c31-3296-4330-88c0-31e0763127f2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:32.971881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6c31-3296-4330-88c0-31e0763127f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:32.973198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a6c31-3296-4330-88c0-31e0763127f2 None admin] PATH_INFO: `/v3/users/c015b0aa3d6c4b6cae552153960e6eb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:32.992042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a6c31-3296-4330-88c0-31e0763127f2 None admin] RBAC: Authorizing `identity:get_user(user_id=c015b0aa3d6c4b6cae552153960e6eb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:32.993852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a6c31-3296-4330-88c0-31e0763127f2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:32.999005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 63/127] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:32 2022] GET /identity/v3/users/c015b0aa3d6c4b6cae552153960e6eb3 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:33.003334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a6c31-3296-4330-88c0-31e0763127f2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:33.065322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337e65e-f92a-47dd-b6d3-57d3d8e2d50a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:33.142208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201f1b4-a786-4714-a045-2b50d9b5b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:33.145640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201f1b4-a786-4714-a045-2b50d9b5b395 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:33.146134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201f1b4-a786-4714-a045-2b50d9b5b395 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:33.146626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201f1b4-a786-4714-a045-2b50d9b5b395 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:33.149043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201f1b4-a786-4714-a045-2b50d9b5b395 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:33.152269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201f1b4-a786-4714-a045-2b50d9b5b395 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:33.155106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 65/128] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:32 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:33.158732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201f1b4-a786-4714-a045-2b50d9b5b395 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:33.190018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:33.217372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a6c31-3296-4330-88c0-31e0763127f2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:33.260506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443f7e5-db21-4316-8a9f-e1c8882261b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:33.263919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f7e5-db21-4316-8a9f-e1c8882261b4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:33.264459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f7e5-db21-4316-8a9f-e1c8882261b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:33.264937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f7e5-db21-4316-8a9f-e1c8882261b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:33.289123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443f7e5-db21-4316-8a9f-e1c8882261b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-f443f7e5-db21-4316-8a9f-e1c8882261b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:33.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:33.301525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:33.302284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 64/129] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:33.303006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443f7e5-db21-4316-8a9f-e1c8882261b4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:33.342529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201f1b4-a786-4714-a045-2b50d9b5b395 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:33.385206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaf7ac-cb0d-419b-bc10-ff1ce0243de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:33.387491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaf7ac-cb0d-419b-bc10-ff1ce0243de3 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:33.389177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaf7ac-cb0d-419b-bc10-ff1ce0243de3 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:33.389735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaf7ac-cb0d-419b-bc10-ff1ce0243de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:33.431301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:33.519597 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443f7e5-db21-4316-8a9f-e1c8882261b4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:33.522146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beaf7ac-cb0d-419b-bc10-ff1ce0243de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:33.529773 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beaf7ac-cb0d-419b-bc10-ff1ce0243de3 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:33.557664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3768-dd21-411b-825a-caca100f1848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:33.558346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3768-dd21-411b-825a-caca100f1848 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:33.558634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3768-dd21-411b-825a-caca100f1848 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:33.559095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3768-dd21-411b-825a-caca100f1848 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/users/c7c7587f428b4eecaea47868f0004d3f/roles/b1f864ecbe4c43b4a5a708fa216488d4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:33.561768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3768-dd21-411b-825a-caca100f1848 None admin] RBAC: Authorizing `identity:create_grant(project_id=270803d5e32745d7be36c6fe3ecd55aa, user_id=c7c7587f428b4eecaea47868f0004d3f, role_id=b1f864ecbe4c43b4a5a708fa216488d4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:33.563380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3768-dd21-411b-825a-caca100f1848 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:33.574481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:33.581030 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 65/130] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:33 2022] PUT /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/users/c7c7587f428b4eecaea47868f0004d3f/roles/b1f864ecbe4c43b4a5a708fa216488d4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:33.583057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3768-dd21-411b-825a-caca100f1848 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:33.706887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3768-dd21-411b-825a-caca100f1848 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:33.711312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:33.748199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:33.749261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:33.749639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:33.750103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:33.751097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:33.751589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:33.753133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:33.763446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 66/131] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:33.770279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:33.796933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 66/132] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:33.820786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaf7ac-cb0d-419b-bc10-ff1ce0243de3 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:33.973390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081a337-4da0-4eb6-84ce-9adbfba959fb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:34.016521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaf7ac-cb0d-419b-bc10-ff1ce0243de3 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:34.041154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4963-c716-4836-b53c-98b79a7ebc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:34.041811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4963-c716-4836-b53c-98b79a7ebc60 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.042093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4963-c716-4836-b53c-98b79a7ebc60 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.042370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4963-c716-4836-b53c-98b79a7ebc60 None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.043669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b4963-c716-4836-b53c-98b79a7ebc60 None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:34.045127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b4963-c716-4836-b53c-98b79a7ebc60 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:34.046736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 67/133] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:33 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:34.052149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4963-c716-4836-b53c-98b79a7ebc60 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:34.059635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:34.086243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a666-505f-4616-b03d-0c3b46d3caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:34.086898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a666-505f-4616-b03d-0c3b46d3caa8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.087202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a666-505f-4616-b03d-0c3b46d3caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.090330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29a666-505f-4616-b03d-0c3b46d3caa8 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.092798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29a666-505f-4616-b03d-0c3b46d3caa8 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:34.094269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29a666-505f-4616-b03d-0c3b46d3caa8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:34.100216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 67/134] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:33 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:34.117273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:34.125030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a666-505f-4616-b03d-0c3b46d3caa8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:34.240764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29a666-505f-4616-b03d-0c3b46d3caa8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:34.245110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4963-c716-4836-b53c-98b79a7ebc60 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:34.288303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de453-1f33-49cb-94eb-dbbb42f2f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:34.288965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de453-1f33-49cb-94eb-dbbb42f2f99c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.289243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de453-1f33-49cb-94eb-dbbb42f2f99c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.291307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de453-1f33-49cb-94eb-dbbb42f2f99c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.292139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de453-1f33-49cb-94eb-dbbb42f2f99c None admin] RBAC: Adding query filter params (role.id=bc25d3d5fc6a4fb19a587d70e771145d, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa, user.id=c015b0aa3d6c4b6cae552153960e6eb3) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:34.292456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de453-1f33-49cb-94eb-dbbb42f2f99c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:34.293924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de453-1f33-49cb-94eb-dbbb42f2f99c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:34.300116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 68/135] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:34 2022] GET /identity/v3/role_assignments?user.id=c015b0aa3d6c4b6cae552153960e6eb3&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=bc25d3d5fc6a4fb19a587d70e771145d => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:34.301416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a13f3-2308-4471-843b-ac4c420da582 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.301705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a13f3-2308-4471-843b-ac4c420da582 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.302040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a13f3-2308-4471-843b-ac4c420da582 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.303370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 69/136] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:34.310230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9d6bf-9c5d-4355-a39c-5fee648dca97 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.310527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9d6bf-9c5d-4355-a39c-5fee648dca97 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.310792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9d6bf-9c5d-4355-a39c-5fee648dca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.331916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-84d9d6bf-9c5d-4355-a39c-5fee648dca97 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:34.333151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-84d9d6bf-9c5d-4355-a39c-5fee648dca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:34.360281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74712acf-259e-4911-8f17-10319d6120fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:34.360964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712acf-259e-4911-8f17-10319d6120fb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.361258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712acf-259e-4911-8f17-10319d6120fb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.361544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74712acf-259e-4911-8f17-10319d6120fb None admin] PATH_INFO: `/v3/projects/64a9e130106d4b488035ba02efb493ce` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.367907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74712acf-259e-4911-8f17-10319d6120fb None admin] RBAC: Authorizing `identity:get_project(project_id=64a9e130106d4b488035ba02efb493ce)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:34.369535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74712acf-259e-4911-8f17-10319d6120fb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:34.371620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 68/137] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:34 2022] GET /identity/v3/projects/64a9e130106d4b488035ba02efb493ce => generated 312 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:34.377156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74712acf-259e-4911-8f17-10319d6120fb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:34.435438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:34.480374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 70/138] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:34.516891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9d6bf-9c5d-4355-a39c-5fee648dca97 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:34.576925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74712acf-259e-4911-8f17-10319d6120fb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:34.587283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:34.643405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f908756-d629-4398-a020-d10a0d494403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:34.644246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f908756-d629-4398-a020-d10a0d494403 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.644540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f908756-d629-4398-a020-d10a0d494403 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.645069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f908756-d629-4398-a020-d10a0d494403 None admin] PATH_INFO: `/v3/projects/64a9e130106d4b488035ba02efb493ce/users/c7c7587f428b4eecaea47868f0004d3f/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.647248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f908756-d629-4398-a020-d10a0d494403 None admin] RBAC: Authorizing `identity:create_grant(project_id=64a9e130106d4b488035ba02efb493ce, user_id=c7c7587f428b4eecaea47868f0004d3f, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:34.648862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f908756-d629-4398-a020-d10a0d494403 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:34.667234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 69/139] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:34 2022] PUT /identity/v3/projects/64a9e130106d4b488035ba02efb493ce/users/c7c7587f428b4eecaea47868f0004d3f/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:38:34.682610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0ae8-d68d-47f4-9075-233c14748271 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.682970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0ae8-d68d-47f4-9075-233c14748271 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.683399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0ae8-d68d-47f4-9075-233c14748271 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.684977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 70/140] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:34.691138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1fc2e-35e6-4bd1-bd52-664e91f60090 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.691422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1fc2e-35e6-4bd1-bd52-664e91f60090 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.691706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1fc2e-35e6-4bd1-bd52-664e91f60090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.722097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4bd1fc2e-35e6-4bd1-bd52-664e91f60090 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:34.723509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4bd1fc2e-35e6-4bd1-bd52-664e91f60090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:34.769138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9d6bf-9c5d-4355-a39c-5fee648dca97 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:34.821110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 71/141] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:34.847263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1fc2e-35e6-4bd1-bd52-664e91f60090 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:34.890601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f6fa4-5b20-498b-ade5-6e2486a7fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:34.895795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f6fa4-5b20-498b-ade5-6e2486a7fc9d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:34.896096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f6fa4-5b20-498b-ade5-6e2486a7fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:34.896384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f6fa4-5b20-498b-ade5-6e2486a7fc9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:34.917207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f6fa4-5b20-498b-ade5-6e2486a7fc9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-7a5f6fa4-5b20-498b-ade5-6e2486a7fc9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:34.922331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:34.923258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:34.924005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 71/142] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:34.930988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f6fa4-5b20-498b-ade5-6e2486a7fc9d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:34.995300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:34.999592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1fc2e-35e6-4bd1-bd52-664e91f60090 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:35.039898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ca30a-4689-48f9-b4f4-c70c8cbb725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:35.040526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca30a-4689-48f9-b4f4-c70c8cbb725c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.041723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca30a-4689-48f9-b4f4-c70c8cbb725c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.041999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca30a-4689-48f9-b4f4-c70c8cbb725c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.048678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:35.053930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ca30a-4689-48f9-b4f4-c70c8cbb725c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-a20ca30a-4689-48f9-b4f4-c70c8cbb725c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:35.060787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:35.061642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:35.062491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 72/143] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:35.067513 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8578-0847-4b48-b9f6-fbd8b176a634 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.067808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8578-0847-4b48-b9f6-fbd8b176a634 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.068091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8578-0847-4b48-b9f6-fbd8b176a634 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.069545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 73/144] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:35.070977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb8578-0847-4b48-b9f6-fbd8b176a634 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:35.180895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb8578-0847-4b48-b9f6-fbd8b176a634 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:35.219974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6cace-3bf5-44eb-aabf-183eb93b967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:35.220609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6cace-3bf5-44eb-aabf-183eb93b967e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.220892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6cace-3bf5-44eb-aabf-183eb93b967e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.221166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6cace-3bf5-44eb-aabf-183eb93b967e None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.222095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6cace-3bf5-44eb-aabf-183eb93b967e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:35.222403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6cace-3bf5-44eb-aabf-183eb93b967e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:35.223852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6cace-3bf5-44eb-aabf-183eb93b967e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:35.234045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 74/145] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:35.239317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b788d-5230-4ce0-a91c-3e62aaeb2c1e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.239672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b788d-5230-4ce0-a91c-3e62aaeb2c1e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.239960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b788d-5230-4ce0-a91c-3e62aaeb2c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.249068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f6fa4-5b20-498b-ade5-6e2486a7fc9d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:35.263517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-862b788d-5230-4ce0-a91c-3e62aaeb2c1e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:35.264729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-862b788d-5230-4ce0-a91c-3e62aaeb2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:35.287295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:35.315923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:35.316488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.316880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.317168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.317901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:35.318213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:35.319753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:35.337619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 72/146] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:35.339691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:35.341233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 75/147] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:35.347940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b788d-5230-4ce0-a91c-3e62aaeb2c1e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:35.470853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53970ba-596f-4eba-ad99-25787a4f4396 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:35.483281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:35.508748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09d746-e3d3-48fc-a0eb-3b46f7c27c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:35.509402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09d746-e3d3-48fc-a0eb-3b46f7c27c36 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.509846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09d746-e3d3-48fc-a0eb-3b46f7c27c36 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.510137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09d746-e3d3-48fc-a0eb-3b46f7c27c36 None admin] PATH_INFO: `/v3/users/312d9f01937f4f95a328912567973a43` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.511929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09d746-e3d3-48fc-a0eb-3b46f7c27c36 None admin] RBAC: Authorizing `identity:get_user(user_id=312d9f01937f4f95a328912567973a43)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:35.513410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09d746-e3d3-48fc-a0eb-3b46f7c27c36 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:35.515046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 73/148] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:35 2022] GET /identity/v3/users/312d9f01937f4f95a328912567973a43 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:35.516573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09d746-e3d3-48fc-a0eb-3b46f7c27c36 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:35.630789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09d746-e3d3-48fc-a0eb-3b46f7c27c36 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:35.645131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b788d-5230-4ce0-a91c-3e62aaeb2c1e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:35.668308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5387-533b-4447-987c-d028eeb46559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:35.669446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5387-533b-4447-987c-d028eeb46559 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.669738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5387-533b-4447-987c-d028eeb46559 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.670025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5387-533b-4447-987c-d028eeb46559 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.671315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5387-533b-4447-987c-d028eeb46559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:35.672774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d5387-533b-4447-987c-d028eeb46559 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:35.674546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 74/149] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:35.675272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5387-533b-4447-987c-d028eeb46559 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:35.731496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:35.781965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5387-533b-4447-987c-d028eeb46559 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:35.784181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6701bc-f8c6-409c-a5b4-13ce7f042a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:35.784853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6701bc-f8c6-409c-a5b4-13ce7f042a80 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.785148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6701bc-f8c6-409c-a5b4-13ce7f042a80 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.785423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6701bc-f8c6-409c-a5b4-13ce7f042a80 None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.786616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6701bc-f8c6-409c-a5b4-13ce7f042a80 None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:35.788139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6701bc-f8c6-409c-a5b4-13ce7f042a80 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:35.789916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 76/150] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:35 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:35.790501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6701bc-f8c6-409c-a5b4-13ce7f042a80 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:35.830987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1edf-5eba-4e90-86e0-8fee9bed7279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:35.832444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:35.833083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1edf-5eba-4e90-86e0-8fee9bed7279 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:35.833382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1edf-5eba-4e90-86e0-8fee9bed7279 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:35.833663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1edf-5eba-4e90-86e0-8fee9bed7279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:35.986629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1edf-5eba-4e90-86e0-8fee9bed7279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:35.988163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1edf-5eba-4e90-86e0-8fee9bed7279 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:36.018255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6701bc-f8c6-409c-a5b4-13ce7f042a80 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:36.079282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:36.115704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999035-7c7e-4d71-b799-b4713d301d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:36.116347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999035-7c7e-4d71-b799-b4713d301d2d None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:36.116627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999035-7c7e-4d71-b799-b4713d301d2d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:36.116899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999035-7c7e-4d71-b799-b4713d301d2d None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:36.117598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999035-7c7e-4d71-b799-b4713d301d2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:36.119090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999035-7c7e-4d71-b799-b4713d301d2d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:36.153313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 75/151] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:36.154499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1edf-5eba-4e90-86e0-8fee9bed7279 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:36.174396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 77/152] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:38:35 2022] POST /identity/v3/users => generated 283 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:36.175280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999035-7c7e-4d71-b799-b4713d301d2d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:36.316989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:36.381667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999035-7c7e-4d71-b799-b4713d301d2d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:36.393111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1edf-5eba-4e90-86e0-8fee9bed7279 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:36.430260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5418e-ce83-4ff8-838f-cc55e1581233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:36.431376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5418e-ce83-4ff8-838f-cc55e1581233 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:36.432437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5418e-ce83-4ff8-838f-cc55e1581233 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:36.432859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5418e-ce83-4ff8-838f-cc55e1581233 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:36.434212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5418e-ce83-4ff8-838f-cc55e1581233 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:36.435924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5418e-ce83-4ff8-838f-cc55e1581233 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:36.437886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 78/153] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:36 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:36.443793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5418e-ce83-4ff8-838f-cc55e1581233 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:36.458742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cf31e-05b6-42fa-9534-86e038155e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:36.459630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cf31e-05b6-42fa-9534-86e038155e11 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:36.460232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cf31e-05b6-42fa-9534-86e038155e11 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:36.462004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cf31e-05b6-42fa-9534-86e038155e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:36.482969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:36.585025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cf31e-05b6-42fa-9534-86e038155e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:36.586704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cf31e-05b6-42fa-9534-86e038155e11 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:36.622710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5418e-ce83-4ff8-838f-cc55e1581233 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:36.675813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4318a3-566d-4d2d-892c-618fa6158f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:36.676414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4318a3-566d-4d2d-892c-618fa6158f57 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:36.676697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4318a3-566d-4d2d-892c-618fa6158f57 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:36.676970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4318a3-566d-4d2d-892c-618fa6158f57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:36.677969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4318a3-566d-4d2d-892c-618fa6158f57 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa, user.id=312d9f01937f4f95a328912567973a43) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:36.678291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4318a3-566d-4d2d-892c-618fa6158f57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:36.679782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4318a3-566d-4d2d-892c-618fa6158f57 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:36.683726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:36.687183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 79/154] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:36 2022] GET /identity/v3/role_assignments?user.id=312d9f01937f4f95a328912567973a43&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=53894f3146884908ba6dd3e118397fb3 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:36.688770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e7c9f-0110-450d-982c-50162ff31c8a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:36.689128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e7c9f-0110-450d-982c-50162ff31c8a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:36.689411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e7c9f-0110-450d-982c-50162ff31c8a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:36.693341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 80/155] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:36.694954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4af1-3bcd-4919-aafb-d54d90d4cc09 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:36.695406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4af1-3bcd-4919-aafb-d54d90d4cc09 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:36.695912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4af1-3bcd-4919-aafb-d54d90d4cc09 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:36.698125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 81/156] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:36.701908 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1711d4b-6802-4846-b8bd-bf11570bc828 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:36.702470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1711d4b-6802-4846-b8bd-bf11570bc828 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:36.702920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1711d4b-6802-4846-b8bd-bf11570bc828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:36.725188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a1711d4b-6802-4846-b8bd-bf11570bc828 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:36.727737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a1711d4b-6802-4846-b8bd-bf11570bc828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:36.730570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 76/157] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:36.732216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f20e-4d9d-4ea6-8de6-2e940ba9989b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:36.732563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f20e-4d9d-4ea6-8de6-2e940ba9989b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:36.738051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f20e-4d9d-4ea6-8de6-2e940ba9989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:36.768296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a8b1f20e-4d9d-4ea6-8de6-2e940ba9989b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:36.770494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a8b1f20e-4d9d-4ea6-8de6-2e940ba9989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:36.820355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:36.827203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 82/158] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:36.828303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1711d4b-6802-4846-b8bd-bf11570bc828 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:36.880608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 77/159] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:36.881938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f20e-4d9d-4ea6-8de6-2e940ba9989b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:36.997201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1711d4b-6802-4846-b8bd-bf11570bc828 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.014379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f20e-4d9d-4ea6-8de6-2e940ba9989b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.032726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:37.040217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dd827-2eae-4c9c-9160-dbf3e1315ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.041704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dd827-2eae-4c9c-9160-dbf3e1315ff8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.042202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dd827-2eae-4c9c-9160-dbf3e1315ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.042616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dd827-2eae-4c9c-9160-dbf3e1315ff8 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.043997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dd827-2eae-4c9c-9160-dbf3e1315ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:37.045740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dd827-2eae-4c9c-9160-dbf3e1315ff8 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:37.047620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 83/160] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:36 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:37.053508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dd827-2eae-4c9c-9160-dbf3e1315ff8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.056599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e406b-9e7e-4337-a8e7-0e333b5e117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.057771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e406b-9e7e-4337-a8e7-0e333b5e117d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.058061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e406b-9e7e-4337-a8e7-0e333b5e117d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.058337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e406b-9e7e-4337-a8e7-0e333b5e117d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.070424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e406b-9e7e-4337-a8e7-0e333b5e117d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-b23e406b-9e7e-4337-a8e7-0e333b5e117d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:37.075559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:37.076489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:37.077301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 78/161] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:38:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:37.077970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e406b-9e7e-4337-a8e7-0e333b5e117d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.112193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:37.174430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dd827-2eae-4c9c-9160-dbf3e1315ff8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.189596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e406b-9e7e-4337-a8e7-0e333b5e117d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.214826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4751d1-3d0e-4fda-94cd-c28117de6acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.215533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4751d1-3d0e-4fda-94cd-c28117de6acb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.215820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4751d1-3d0e-4fda-94cd-c28117de6acb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.216100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4751d1-3d0e-4fda-94cd-c28117de6acb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.234479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4751d1-3d0e-4fda-94cd-c28117de6acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:37.235583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924b780-476b-452d-8cc2-1ea71a6c368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.236214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924b780-476b-452d-8cc2-1ea71a6c368c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.236499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924b780-476b-452d-8cc2-1ea71a6c368c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.236777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924b780-476b-452d-8cc2-1ea71a6c368c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.237586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924b780-476b-452d-8cc2-1ea71a6c368c None admin] RBAC: Adding query filter params (role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa, user.id=c7c7587f428b4eecaea47868f0004d3f) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:37.237899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924b780-476b-452d-8cc2-1ea71a6c368c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:37.239412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924b780-476b-452d-8cc2-1ea71a6c368c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-2d4751d1-3d0e-4fda-94cd-c28117de6acb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:37.239710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:37.240558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:37.241334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 84/162] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:37.242003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4751d1-3d0e-4fda-94cd-c28117de6acb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.249358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 79/163] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/role_assignments?user.id=c7c7587f428b4eecaea47868f0004d3f&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:37.250626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ba54-0a5c-421b-9c55-231d30c75f25 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.250917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ba54-0a5c-421b-9c55-231d30c75f25 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.251224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ba54-0a5c-421b-9c55-231d30c75f25 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.252609 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 80/164] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:37.260234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669ba54-0a5c-421b-9c55-231d30c75f25 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.325185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:37.385046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4751d1-3d0e-4fda-94cd-c28117de6acb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.387702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:37.398860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669ba54-0a5c-421b-9c55-231d30c75f25 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.431712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03c890-0f17-48fe-90e4-423351f703f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.432359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03c890-0f17-48fe-90e4-423351f703f1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.432682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03c890-0f17-48fe-90e4-423351f703f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.432917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03c890-0f17-48fe-90e4-423351f703f1 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.433661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03c890-0f17-48fe-90e4-423351f703f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:37.434126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03c890-0f17-48fe-90e4-423351f703f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:37.436193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03c890-0f17-48fe-90e4-423351f703f1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:37.445356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.446128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 85/165] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:37.446649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.447270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.447444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab15a-e6a2-47f2-8f10-5a14daafa958 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.447744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab15a-e6a2-47f2-8f10-5a14daafa958 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.448026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab15a-e6a2-47f2-8f10-5a14daafa958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.448351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.449279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:37.449779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:37.452403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:37.467379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 81/166] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:37.468353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.469170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b91ab15a-e6a2-47f2-8f10-5a14daafa958 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:37.470382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b91ab15a-e6a2-47f2-8f10-5a14daafa958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:37.561189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 86/167] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:37.562611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ab15a-e6a2-47f2-8f10-5a14daafa958 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.609887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfaa98-ff4d-4c39-a9fb-faae5d0739e2 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.627830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:37.647782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea2ee-a30f-4b58-9c6d-f4c11e3bb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.648441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea2ee-a30f-4b58-9c6d-f4c11e3bb140 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.648726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea2ee-a30f-4b58-9c6d-f4c11e3bb140 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.649006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea2ee-a30f-4b58-9c6d-f4c11e3bb140 None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.650190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ea2ee-a30f-4b58-9c6d-f4c11e3bb140 None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:37.652214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ea2ee-a30f-4b58-9c6d-f4c11e3bb140 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:37.653862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 82/168] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:37.654644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea2ee-a30f-4b58-9c6d-f4c11e3bb140 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.685157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ab15a-e6a2-47f2-8f10-5a14daafa958 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.687246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:37.727238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3fc8e-24ce-485e-aa0f-eb95053d6361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.728143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fc8e-24ce-485e-aa0f-eb95053d6361 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.730141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fc8e-24ce-485e-aa0f-eb95053d6361 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.730349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fc8e-24ce-485e-aa0f-eb95053d6361 None admin] PATH_INFO: `/v3/users/c015b0aa3d6c4b6cae552153960e6eb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.731576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3fc8e-24ce-485e-aa0f-eb95053d6361 None admin] RBAC: Authorizing `identity:get_user(user_id=c015b0aa3d6c4b6cae552153960e6eb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:37.733041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3fc8e-24ce-485e-aa0f-eb95053d6361 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:37.736825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 87/169] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/users/c015b0aa3d6c4b6cae552153960e6eb3 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:37.737567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3fc8e-24ce-485e-aa0f-eb95053d6361 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.830855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea2ee-a30f-4b58-9c6d-f4c11e3bb140 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:37.900001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd9296-8a7b-450d-91aa-d4bdcb326017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:37.901464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9296-8a7b-450d-91aa-d4bdcb326017 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:37.901751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9296-8a7b-450d-91aa-d4bdcb326017 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:37.902026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9296-8a7b-450d-91aa-d4bdcb326017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:37.919917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd9296-8a7b-450d-91aa-d4bdcb326017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-8bcd9296-8a7b-450d-91aa-d4bdcb326017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:37.925493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:37.926360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 83/170] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:37.927607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd9296-8a7b-450d-91aa-d4bdcb326017 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:37.976788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3fc8e-24ce-485e-aa0f-eb95053d6361 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:38.011614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:38.044901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:38.047494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504ae3e-e92c-4cee-9c92-b66c29ad4bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:38.049584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504ae3e-e92c-4cee-9c92-b66c29ad4bdf None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:38.050056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504ae3e-e92c-4cee-9c92-b66c29ad4bdf None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:38.050650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504ae3e-e92c-4cee-9c92-b66c29ad4bdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:38.081453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd9296-8a7b-450d-91aa-d4bdcb326017 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:38.153733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2f64-b3c4-44cb-8907-2e46747f2334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:38.154736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2f64-b3c4-44cb-8907-2e46747f2334 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:38.155253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2f64-b3c4-44cb-8907-2e46747f2334 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:38.155724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2f64-b3c4-44cb-8907-2e46747f2334 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:38.158220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded2f64-b3c4-44cb-8907-2e46747f2334 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:38.159975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded2f64-b3c4-44cb-8907-2e46747f2334 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:38.164065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 84/171] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:38.165767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2f64-b3c4-44cb-8907-2e46747f2334 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:38.184545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504ae3e-e92c-4cee-9c92-b66c29ad4bdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:38.186330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504ae3e-e92c-4cee-9c92-b66c29ad4bdf None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:38.302549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 88/172] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:38.303874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504ae3e-e92c-4cee-9c92-b66c29ad4bdf None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:38.335365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:38.405764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2f64-b3c4-44cb-8907-2e46747f2334 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:38.412713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504ae3e-e92c-4cee-9c92-b66c29ad4bdf None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:38.452531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f288b6-7469-4f59-bec1-4e98f12f631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:38.453221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f288b6-7469-4f59-bec1-4e98f12f631e None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:38.453503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f288b6-7469-4f59-bec1-4e98f12f631e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:38.453781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f288b6-7469-4f59-bec1-4e98f12f631e None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/users/c015b0aa3d6c4b6cae552153960e6eb3/roles/bc25d3d5fc6a4fb19a587d70e771145d` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:38.456125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f288b6-7469-4f59-bec1-4e98f12f631e None admin] RBAC: Authorizing `identity:create_grant(project_id=270803d5e32745d7be36c6fe3ecd55aa, user_id=c015b0aa3d6c4b6cae552153960e6eb3, role_id=bc25d3d5fc6a4fb19a587d70e771145d)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:38.457599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f288b6-7469-4f59-bec1-4e98f12f631e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:38.472406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 89/173] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:38 2022] PUT /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/users/c015b0aa3d6c4b6cae552153960e6eb3/roles/bc25d3d5fc6a4fb19a587d70e771145d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:38.473675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f288b6-7469-4f59-bec1-4e98f12f631e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:38.513918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:38.514904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:38.515504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:38.516052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:38.517095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:38.517598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:38.519288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:38.539063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 85/174] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:38.546172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:38.570993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:38.580624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:38.602805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f288b6-7469-4f59-bec1-4e98f12f631e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:38.649124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e80e2-13a1-4370-99ca-466a4d029e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:38.649993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e80e2-13a1-4370-99ca-466a4d029e00 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:38.651026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e80e2-13a1-4370-99ca-466a4d029e00 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:38.651430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e80e2-13a1-4370-99ca-466a4d029e00 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:38.652990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e80e2-13a1-4370-99ca-466a4d029e00 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:38.654755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e80e2-13a1-4370-99ca-466a4d029e00 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:38.656749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 90/175] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:38 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:38.662535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e80e2-13a1-4370-99ca-466a4d029e00 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:38.732497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf257b-e202-4bfd-ad98-b0d18248395f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:38.770966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a3da-ae4a-4769-a16a-253debe3b9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:38.771619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a3da-ae4a-4769-a16a-253debe3b9fa None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:38.771899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a3da-ae4a-4769-a16a-253debe3b9fa None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:38.772172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a3da-ae4a-4769-a16a-253debe3b9fa None admin] PATH_INFO: `/v3/users/c7c7587f428b4eecaea47868f0004d3f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:38.773356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a3da-ae4a-4769-a16a-253debe3b9fa None admin] RBAC: Authorizing `identity:get_user(user_id=c7c7587f428b4eecaea47868f0004d3f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:38.774810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a3da-ae4a-4769-a16a-253debe3b9fa None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:38.777455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 86/176] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:38 2022] GET /identity/v3/users/c7c7587f428b4eecaea47868f0004d3f => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:38.787909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a3da-ae4a-4769-a16a-253debe3b9fa None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:38.793907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e80e2-13a1-4370-99ca-466a4d029e00 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:38.834223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:38.834905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:38.835224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:38.835652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:38.836467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] RBAC: Adding query filter params (role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa, user.id=c7c7587f428b4eecaea47868f0004d3f) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:38.836781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:38.838781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:38.850965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 91/177] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:38 2022] GET /identity/v3/role_assignments?user.id=c7c7587f428b4eecaea47868f0004d3f&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:38.972664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:38.992160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a3da-ae4a-4769-a16a-253debe3b9fa None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:39.028504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7becff9-2874-47a2-8163-507b6f9f0c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:39.029133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7becff9-2874-47a2-8163-507b6f9f0c75 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:39.029415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7becff9-2874-47a2-8163-507b6f9f0c75 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:39.029686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7becff9-2874-47a2-8163-507b6f9f0c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:39.121798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7becff9-2874-47a2-8163-507b6f9f0c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:39.123309 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7becff9-2874-47a2-8163-507b6f9f0c75 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:39.220892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:39.246638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 87/178] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:39.252704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:39.266306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:39.364080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31fe9f-b902-4e2a-9427-07cc6ace5efc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:39.402745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1550-3f74-4ad4-9f54-d013db411f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:39.403773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1550-3f74-4ad4-9f54-d013db411f03 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:39.404256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1550-3f74-4ad4-9f54-d013db411f03 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:39.404753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1550-3f74-4ad4-9f54-d013db411f03 None admin] PATH_INFO: `/v3/projects/64a9e130106d4b488035ba02efb493ce` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:39.408392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e1550-3f74-4ad4-9f54-d013db411f03 None admin] RBAC: Authorizing `identity:get_project(project_id=64a9e130106d4b488035ba02efb493ce)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:39.410106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e1550-3f74-4ad4-9f54-d013db411f03 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:39.412068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 92/179] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:39 2022] GET /identity/v3/projects/64a9e130106d4b488035ba02efb493ce => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:39.418319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7becff9-2874-47a2-8163-507b6f9f0c75 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:39.544879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7becff9-2874-47a2-8163-507b6f9f0c75 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:39.591722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f202bf-0746-4cc2-8f5a-45af9f94f62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:39.592705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f202bf-0746-4cc2-8f5a-45af9f94f62c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:39.593184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f202bf-0746-4cc2-8f5a-45af9f94f62c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:39.593665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f202bf-0746-4cc2-8f5a-45af9f94f62c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:39.594669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f202bf-0746-4cc2-8f5a-45af9f94f62c None admin] RBAC: Adding query filter params (role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=64a9e130106d4b488035ba02efb493ce, user.id=c7c7587f428b4eecaea47868f0004d3f) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:39.595327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f202bf-0746-4cc2-8f5a-45af9f94f62c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:39.596998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f202bf-0746-4cc2-8f5a-45af9f94f62c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:39.605503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 88/180] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:39 2022] GET /identity/v3/role_assignments?user.id=c7c7587f428b4eecaea47868f0004d3f&scope.project.id=64a9e130106d4b488035ba02efb493ce&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:39.826846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffefe-5de7-4d9a-a9bb-25843c11aaa9 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:39.827524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffefe-5de7-4d9a-a9bb-25843c11aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:39.828008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffefe-5de7-4d9a-a9bb-25843c11aaa9 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:39.829960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 93/181] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:39.836034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd9c7c-fa82-4c73-85b9-68ec21a8ff5f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:39.836905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd9c7c-fa82-4c73-85b9-68ec21a8ff5f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:39.837421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd9c7c-fa82-4c73-85b9-68ec21a8ff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:39.871535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8ebd9c7c-fa82-4c73-85b9-68ec21a8ff5f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:39.872759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8ebd9c7c-fa82-4c73-85b9-68ec21a8ff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:39.904976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8c7f-c854-42ae-ad4f-6d1c9219238f None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:39.905255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8c7f-c854-42ae-ad4f-6d1c9219238f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:39.905535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8c7f-c854-42ae-ad4f-6d1c9219238f None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:39.907060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 94/182] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:39.915807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b4ea-6a8e-43e6-b803-7a3aa8fcbd83 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:39.915982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b4ea-6a8e-43e6-b803-7a3aa8fcbd83 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:39.916202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52b4ea-6a8e-43e6-b803-7a3aa8fcbd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:39.938476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ee52b4ea-6a8e-43e6-b803-7a3aa8fcbd83 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:39.939707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:39.942043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ee52b4ea-6a8e-43e6-b803-7a3aa8fcbd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:39.979143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 89/183] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:39.992348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284fdd-c329-47fa-9885-407f092c7883 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:39.992888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284fdd-c329-47fa-9885-407f092c7883 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:39.993360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284fdd-c329-47fa-9885-407f092c7883 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:39.996564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 90/184] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:40.001410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd326b-685f-43e7-8c0d-3fc867416292 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.001700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd326b-685f-43e7-8c0d-3fc867416292 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.001978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd326b-685f-43e7-8c0d-3fc867416292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.024322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b6dd326b-685f-43e7-8c0d-3fc867416292 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:40.025959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b6dd326b-685f-43e7-8c0d-3fc867416292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:40.030984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 95/185] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:40.031644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52b4ea-6a8e-43e6-b803-7a3aa8fcbd83 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.042314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:40.112879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 91/186] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:40.113661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd326b-685f-43e7-8c0d-3fc867416292 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.150498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52b4ea-6a8e-43e6-b803-7a3aa8fcbd83 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.186697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27e64-6bf4-47e0-a94c-e1872a0ac916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.187367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27e64-6bf4-47e0-a94c-e1872a0ac916 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.187646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27e64-6bf4-47e0-a94c-e1872a0ac916 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.187917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27e64-6bf4-47e0-a94c-e1872a0ac916 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.198423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae27e64-6bf4-47e0-a94c-e1872a0ac916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-9ae27e64-6bf4-47e0-a94c-e1872a0ac916 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:40.203682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:40.204539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:40.205435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 96/187] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:40.210220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27e64-6bf4-47e0-a94c-e1872a0ac916 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.221114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd326b-685f-43e7-8c0d-3fc867416292 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.229755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:40.260369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99877fc-25b6-49b7-a704-154f0e09f0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.261023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99877fc-25b6-49b7-a704-154f0e09f0d8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.261304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99877fc-25b6-49b7-a704-154f0e09f0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.261578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99877fc-25b6-49b7-a704-154f0e09f0d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.273238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99877fc-25b6-49b7-a704-154f0e09f0d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:40.276640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-f99877fc-25b6-49b7-a704-154f0e09f0d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:40.279185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:40.280055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 92/188] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:40.281210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99877fc-25b6-49b7-a704-154f0e09f0d8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.317098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27e64-6bf4-47e0-a94c-e1872a0ac916 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.352705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5098-2892-43f7-ab6c-0411d159b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.353360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5098-2892-43f7-ab6c-0411d159b60e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.354208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5098-2892-43f7-ab6c-0411d159b60e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.354487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5098-2892-43f7-ab6c-0411d159b60e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.355671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5098-2892-43f7-ab6c-0411d159b60e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:40.357125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5098-2892-43f7-ab6c-0411d159b60e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:40.358893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 97/189] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:40.359657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5098-2892-43f7-ab6c-0411d159b60e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.388425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99877fc-25b6-49b7-a704-154f0e09f0d8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.424848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.429585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.429913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.430202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.430964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:40.431278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:40.432703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:40.442264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 93/190] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:40.442264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.465872 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5098-2892-43f7-ab6c-0411d159b60e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.474640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:40.502196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.502814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.503121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.503390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.504386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:40.504696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:40.506076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:40.508257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:40.520699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 98/191] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:40.520699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.554206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb904-d645-437e-ae2c-e0cd76273234 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.589574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c5c2d-214b-42ba-b38a-8caaba986227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.590203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5c2d-214b-42ba-b38a-8caaba986227 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.590487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5c2d-214b-42ba-b38a-8caaba986227 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.590766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5c2d-214b-42ba-b38a-8caaba986227 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.591487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c5c2d-214b-42ba-b38a-8caaba986227 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:40.592974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c5c2d-214b-42ba-b38a-8caaba986227 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:40.618446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 94/192] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:38:40 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:40.619350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c5c2d-214b-42ba-b38a-8caaba986227 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.639531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3615067-5478-4362-98d0-f9e587d5cdcb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.691817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f7ae4-fe1b-45c2-ac38-cafb37279554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.692487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7ae4-fe1b-45c2-ac38-cafb37279554 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.692773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7ae4-fe1b-45c2-ac38-cafb37279554 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.693051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7ae4-fe1b-45c2-ac38-cafb37279554 None admin] PATH_INFO: `/v3/users/8a81e6a5759749a7b20c04dc07d3eacf` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.709063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f7ae4-fe1b-45c2-ac38-cafb37279554 None admin] RBAC: Authorizing `identity:get_user(user_id=8a81e6a5759749a7b20c04dc07d3eacf)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:40.710565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f7ae4-fe1b-45c2-ac38-cafb37279554 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:40.712536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 99/193] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/users/8a81e6a5759749a7b20c04dc07d3eacf => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:40.714263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3479b-ff7c-425c-a9bd-bfdb22c10892 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.714553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3479b-ff7c-425c-a9bd-bfdb22c10892 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.714846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3479b-ff7c-425c-a9bd-bfdb22c10892 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.716312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 100/194] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:40.721273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3479b-ff7c-425c-a9bd-bfdb22c10892 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:40.740404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:40.760819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c5c2d-214b-42ba-b38a-8caaba986227 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.784514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:40.806233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d963f7-a383-4737-b65f-4d3aabbded16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.807180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d963f7-a383-4737-b65f-4d3aabbded16 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.807466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d963f7-a383-4737-b65f-4d3aabbded16 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.807741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d963f7-a383-4737-b65f-4d3aabbded16 None admin] PATH_INFO: `/v3/users/8a81e6a5759749a7b20c04dc07d3eacf` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.808953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d963f7-a383-4737-b65f-4d3aabbded16 None admin] RBAC: Authorizing `identity:get_user(user_id=8a81e6a5759749a7b20c04dc07d3eacf)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:40.811581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d963f7-a383-4737-b65f-4d3aabbded16 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:40.812036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 95/195] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/users/8a81e6a5759749a7b20c04dc07d3eacf => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:40.813474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73c13a-1c51-4a5c-9792-aff6426e852a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.813474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73c13a-1c51-4a5c-9792-aff6426e852a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.813703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73c13a-1c51-4a5c-9792-aff6426e852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.836275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-bf73c13a-1c51-4a5c-9792-aff6426e852a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:40.837460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-bf73c13a-1c51-4a5c-9792-aff6426e852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:40.860200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3479b-ff7c-425c-a9bd-bfdb22c10892 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:40.913592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199ff9a-d43d-4872-9271-e192691705c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:40.914227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199ff9a-d43d-4872-9271-e192691705c6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:40.914501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199ff9a-d43d-4872-9271-e192691705c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:40.914770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199ff9a-d43d-4872-9271-e192691705c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:40.935237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 96/196] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:40.935903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73c13a-1c51-4a5c-9792-aff6426e852a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.007917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199ff9a-d43d-4872-9271-e192691705c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:41.009420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199ff9a-d43d-4872-9271-e192691705c6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:41.035068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:41.057715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73c13a-1c51-4a5c-9792-aff6426e852a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:41.082253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:41.097898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74e06e-8e47-48f4-8230-7849a40a4062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:41.098726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74e06e-8e47-48f4-8230-7849a40a4062 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:41.099125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74e06e-8e47-48f4-8230-7849a40a4062 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:41.099472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74e06e-8e47-48f4-8230-7849a40a4062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:41.139106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 101/197] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:41.140299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199ff9a-d43d-4872-9271-e192691705c6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.178429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74e06e-8e47-48f4-8230-7849a40a4062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:41.179963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74e06e-8e47-48f4-8230-7849a40a4062 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:41.258781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199ff9a-d43d-4872-9271-e192691705c6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:41.290236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:41.296465 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c124f-9f60-4623-bd5a-6db800a3be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:41.297224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c124f-9f60-4623-bd5a-6db800a3be87 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:41.297577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c124f-9f60-4623-bd5a-6db800a3be87 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:41.297927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c124f-9f60-4623-bd5a-6db800a3be87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:41.309020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c124f-9f60-4623-bd5a-6db800a3be87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:41.312813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 97/198] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:41.313888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74e06e-8e47-48f4-8230-7849a40a4062 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-fc5c124f-9f60-4623-bd5a-6db800a3be87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:41.314259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:41.315148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:41.315940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 102/199] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:41.323165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c124f-9f60-4623-bd5a-6db800a3be87 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.342810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:41.428314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74e06e-8e47-48f4-8230-7849a40a4062 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:41.439526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c124f-9f60-4623-bd5a-6db800a3be87 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:41.465112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f2465-70bf-4e0a-983e-f365dfbbb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:41.465905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2465-70bf-4e0a-983e-f365dfbbb572 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:41.466287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2465-70bf-4e0a-983e-f365dfbbb572 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:41.466661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2465-70bf-4e0a-983e-f365dfbbb572 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:41.467963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f2465-70bf-4e0a-983e-f365dfbbb572 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:41.469503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f2465-70bf-4e0a-983e-f365dfbbb572 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:41.471650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 98/200] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:41 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:41.472637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f2465-70bf-4e0a-983e-f365dfbbb572 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.483208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd0299-f495-4c3d-acf8-d1f536746c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:41.483945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd0299-f495-4c3d-acf8-d1f536746c71 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:41.484290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd0299-f495-4c3d-acf8-d1f536746c71 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:41.484634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd0299-f495-4c3d-acf8-d1f536746c71 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:41.485895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd0299-f495-4c3d-acf8-d1f536746c71 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:41.487469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd0299-f495-4c3d-acf8-d1f536746c71 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:41.489216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 103/201] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:41 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:41.490101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd0299-f495-4c3d-acf8-d1f536746c71 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.533424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:41.578233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:41.591814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f2465-70bf-4e0a-983e-f365dfbbb572 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:41.595034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd0299-f495-4c3d-acf8-d1f536746c71 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:41.629537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:41.630252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:41.630358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:41.630631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:41.630949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:41.631062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:41.631270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:41.631550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:41.631981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=273944e75b144a7dac98dfa191ba1fa4, user.id=8a81e6a5759749a7b20c04dc07d3eacf) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:41.632268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] RBAC: Adding query filter params (name=reader) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:41.632378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:41.632701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:41.633959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:41.634070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:41.639902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 104/202] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:41 2022] GET /identity/v3/role_assignments?user.id=8a81e6a5759749a7b20c04dc07d3eacf&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=53894f3146884908ba6dd3e118397fb3 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:41.640775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.643545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 99/203] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:41.656233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.788023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f12a-dac7-4c79-8616-e2f99054ab7b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:41.831966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:41.832699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:41.833493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:41.833867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:41.834677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] RBAC: Adding query filter params (role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=273944e75b144a7dac98dfa191ba1fa4, user.id=8a81e6a5759749a7b20c04dc07d3eacf) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:41.835036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:41.836504 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:41.850412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 105/204] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:41 2022] GET /identity/v3/role_assignments?user.id=8a81e6a5759749a7b20c04dc07d3eacf&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:41.880924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb2af-57e0-4fc2-a3f5-e48305bc8fab None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:41.899870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:41.929292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c7b3-c11b-463a-90db-62e69a2c65b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:41.930361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c7b3-c11b-463a-90db-62e69a2c65b6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:41.930838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c7b3-c11b-463a-90db-62e69a2c65b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:41.931361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c7b3-c11b-463a-90db-62e69a2c65b6 None admin] PATH_INFO: `/v3/users/c015b0aa3d6c4b6cae552153960e6eb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:41.932939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313c7b3-c11b-463a-90db-62e69a2c65b6 None admin] RBAC: Authorizing `identity:get_user(user_id=c015b0aa3d6c4b6cae552153960e6eb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:41.934695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313c7b3-c11b-463a-90db-62e69a2c65b6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:41.936860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 100/205] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:41 2022] GET /identity/v3/users/c015b0aa3d6c4b6cae552153960e6eb3 => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:41.942295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:41.968762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:42.092035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872f17e-83d8-45e6-80e2-c37d09e997fe None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:42.137545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7533-b1fb-4a32-aa78-d57269113c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:42.138192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7533-b1fb-4a32-aa78-d57269113c14 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:42.138482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7533-b1fb-4a32-aa78-d57269113c14 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:42.138760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7533-b1fb-4a32-aa78-d57269113c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:42.219604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7533-b1fb-4a32-aa78-d57269113c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:42.221083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7533-b1fb-4a32-aa78-d57269113c14 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:42.234894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:42.342944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 106/206] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:42.352032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c7b3-c11b-463a-90db-62e69a2c65b6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:42.528930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313c7b3-c11b-463a-90db-62e69a2c65b6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:42.565486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a06c1f-5673-497c-8169-e82151b150f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:42.566145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a06c1f-5673-497c-8169-e82151b150f4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:42.566429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a06c1f-5673-497c-8169-e82151b150f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:42.566707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a06c1f-5673-497c-8169-e82151b150f4 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:42.567917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a06c1f-5673-497c-8169-e82151b150f4 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:42.569374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a06c1f-5673-497c-8169-e82151b150f4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:42.576308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 101/207] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:42 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:42.580042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7533-b1fb-4a32-aa78-d57269113c14 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:42.714298 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7533-b1fb-4a32-aa78-d57269113c14 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:42.729204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:42.760909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082f578-5f87-4532-8588-8eb71a27adab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:42.761538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f578-5f87-4532-8588-8eb71a27adab None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:42.761823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f578-5f87-4532-8588-8eb71a27adab None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:42.762102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f578-5f87-4532-8588-8eb71a27adab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:42.762897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082f578-5f87-4532-8588-8eb71a27adab None admin] RBAC: Adding query filter params (role.id=bc25d3d5fc6a4fb19a587d70e771145d, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa, user.id=c015b0aa3d6c4b6cae552153960e6eb3) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:42.763238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082f578-5f87-4532-8588-8eb71a27adab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:42.764701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082f578-5f87-4532-8588-8eb71a27adab None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:42.770810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 107/208] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:42 2022] GET /identity/v3/role_assignments?user.id=c015b0aa3d6c4b6cae552153960e6eb3&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=bc25d3d5fc6a4fb19a587d70e771145d => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:43.076814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4afbbb-9961-49af-a931-109e6a85326b None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.077299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4afbbb-9961-49af-a931-109e6a85326b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.077299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4afbbb-9961-49af-a931-109e6a85326b None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.079128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 102/209] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:43.084040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09d63-d624-402e-aa11-e3951cd255e7 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.084328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09d63-d624-402e-aa11-e3951cd255e7 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.084607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a09d63-d624-402e-aa11-e3951cd255e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.104917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b7a09d63-d624-402e-aa11-e3951cd255e7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:43.106173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b7a09d63-d624-402e-aa11-e3951cd255e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:43.128356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f84d4-7a7e-4a1a-9347-c1738f64ec25 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.128644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f84d4-7a7e-4a1a-9347-c1738f64ec25 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.128913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f84d4-7a7e-4a1a-9347-c1738f64ec25 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.131311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 103/210] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:43.137850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1c7e-1894-44cf-b302-8ec7ef9afedf None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.138140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1c7e-1894-44cf-b302-8ec7ef9afedf None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.138579 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1c7e-1894-44cf-b302-8ec7ef9afedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.161033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1dbd1c7e-1894-44cf-b302-8ec7ef9afedf None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:43.162228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1dbd1c7e-1894-44cf-b302-8ec7ef9afedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:43.183367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 108/211] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:43.206481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a09d63-d624-402e-aa11-e3951cd255e7 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:43.211563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:43.237932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 104/212] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:43.263761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd1c7e-1894-44cf-b302-8ec7ef9afedf None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:43.318232 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a09d63-d624-402e-aa11-e3951cd255e7 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:43.326526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:43.356137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28147c-76fe-46e9-8e20-32d2e592c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:43.356809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28147c-76fe-46e9-8e20-32d2e592c79f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.357094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28147c-76fe-46e9-8e20-32d2e592c79f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.357368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28147c-76fe-46e9-8e20-32d2e592c79f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.372300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28147c-76fe-46e9-8e20-32d2e592c79f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-9d28147c-76fe-46e9-8e20-32d2e592c79f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:43.377736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:43.379861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:43.381257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 109/213] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:43.382034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd1c7e-1894-44cf-b302-8ec7ef9afedf None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:43.394941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28147c-76fe-46e9-8e20-32d2e592c79f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:43.421612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc24a2-e7f0-4833-9a2a-cfea53fbe314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:43.422266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc24a2-e7f0-4833-9a2a-cfea53fbe314 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.422553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc24a2-e7f0-4833-9a2a-cfea53fbe314 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.422829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc24a2-e7f0-4833-9a2a-cfea53fbe314 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.424477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc24a2-e7f0-4833-9a2a-cfea53fbe314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:43.426353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc24a2-e7f0-4833-9a2a-cfea53fbe314 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:43.428967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 105/214] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:43.435746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc24a2-e7f0-4833-9a2a-cfea53fbe314 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:43.501159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:43.522571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28147c-76fe-46e9-8e20-32d2e592c79f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:43.559394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc24a2-e7f0-4833-9a2a-cfea53fbe314 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:43.568583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:43.569909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.570342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.570775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.572143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:43.573372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:43.575203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:43.587281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 110/215] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:43.592845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:43.596951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec694-9426-4888-8a52-c2d8099f7038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:43.598187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec694-9426-4888-8a52-c2d8099f7038 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.598187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec694-9426-4888-8a52-c2d8099f7038 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.598410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec694-9426-4888-8a52-c2d8099f7038 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.599234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeec694-9426-4888-8a52-c2d8099f7038 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:43.600804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeec694-9426-4888-8a52-c2d8099f7038 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:43.631163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 106/216] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:38:43 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:38:43.639510 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:43.719020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e42bc-a1df-493f-b54f-9b46d4d9b981 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:43.761497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ee30-952b-4ffe-a94f-b3a5c3882618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:43.762806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ee30-952b-4ffe-a94f-b3a5c3882618 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.763339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ee30-952b-4ffe-a94f-b3a5c3882618 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.763834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ee30-952b-4ffe-a94f-b3a5c3882618 None admin] PATH_INFO: `/v3/users/8378ec22986f496db9bf371b85a305f7` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:43.780655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2ee30-952b-4ffe-a94f-b3a5c3882618 None admin] RBAC: Authorizing `identity:get_user(user_id=8378ec22986f496db9bf371b85a305f7)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:43.782560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2ee30-952b-4ffe-a94f-b3a5c3882618 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:43.784956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 111/217] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:43 2022] GET /identity/v3/users/8378ec22986f496db9bf371b85a305f7 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:43.790619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec694-9426-4888-8a52-c2d8099f7038 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:43.908131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec694-9426-4888-8a52-c2d8099f7038 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:43.909949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:43.947347 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb44e0-4342-4905-b958-5af18082f543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:43.948134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb44e0-4342-4905-b958-5af18082f543 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:43.948485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb44e0-4342-4905-b958-5af18082f543 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:43.948830 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb44e0-4342-4905-b958-5af18082f543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.008029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac009b6a-1d34-483c-a4b0-7e716ec7397f None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.008782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac009b6a-1d34-483c-a4b0-7e716ec7397f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.009669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac009b6a-1d34-483c-a4b0-7e716ec7397f None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.011660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 112/218] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:44.017649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c8022-624c-4b3e-a741-3d44c3b939c1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.018414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c8022-624c-4b3e-a741-3d44c3b939c1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.019310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c8022-624c-4b3e-a741-3d44c3b939c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.027875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb44e0-4342-4905-b958-5af18082f543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:44.029462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb44e0-4342-4905-b958-5af18082f543 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:44.048377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b71c8022-624c-4b3e-a741-3d44c3b939c1 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:44.049665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b71c8022-624c-4b3e-a741-3d44c3b939c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:44.142547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 113/219] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:44.156304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 107/220] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:44.162306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c8022-624c-4b3e-a741-3d44c3b939c1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.184659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:44.186619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889767-5d6a-4980-bdc4-d2c131135006 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.186916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889767-5d6a-4980-bdc4-d2c131135006 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.187288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889767-5d6a-4980-bdc4-d2c131135006 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.188610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 108/221] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:44.193962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89feee-6f3e-4ff7-99b8-3f5ca5862df8 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.194255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89feee-6f3e-4ff7-99b8-3f5ca5862df8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.194537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89feee-6f3e-4ff7-99b8-3f5ca5862df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.201413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:44.214386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0f89feee-6f3e-4ff7-99b8-3f5ca5862df8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:44.215717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0f89feee-6f3e-4ff7-99b8-3f5ca5862df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:44.276368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c8022-624c-4b3e-a741-3d44c3b939c1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:44.296915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 109/222] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:44.298068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89feee-6f3e-4ff7-99b8-3f5ca5862df8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.312612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c34e6-c4dc-4937-8945-34e92a24aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:44.313320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c34e6-c4dc-4937-8945-34e92a24aa19 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.313605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c34e6-c4dc-4937-8945-34e92a24aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.313875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c34e6-c4dc-4937-8945-34e92a24aa19 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.315132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c34e6-c4dc-4937-8945-34e92a24aa19 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:44.316681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c34e6-c4dc-4937-8945-34e92a24aa19 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:44.318443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 114/223] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:44.324722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c34e6-c4dc-4937-8945-34e92a24aa19 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.416747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89feee-6f3e-4ff7-99b8-3f5ca5862df8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:44.424094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:44.442861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c34e6-c4dc-4937-8945-34e92a24aa19 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:44.462262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:44.468445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451bf03-e3d4-4bf7-9ed1-65696fb8286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:44.469209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451bf03-e3d4-4bf7-9ed1-65696fb8286f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.469610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451bf03-e3d4-4bf7-9ed1-65696fb8286f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.470445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451bf03-e3d4-4bf7-9ed1-65696fb8286f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.482010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451bf03-e3d4-4bf7-9ed1-65696fb8286f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:44.485988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:44.486778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.487228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-e451bf03-e3d4-4bf7-9ed1-65696fb8286f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:44.487592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:44.488597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:44.489562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:44.490402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.491569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 110/224] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:44.491845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] RBAC: Adding query filter params (role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=273944e75b144a7dac98dfa191ba1fa4, user.id=8378ec22986f496db9bf371b85a305f7) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:44.492287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:44.493992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:44.496900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451bf03-e3d4-4bf7-9ed1-65696fb8286f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.501035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 115/225] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/role_assignments?user.id=8378ec22986f496db9bf371b85a305f7&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:44.502186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.612903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451bf03-e3d4-4bf7-9ed1-65696fb8286f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:44.615882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f235e-38e0-4b85-a259-c3383ef6cdf4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:44.653479 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526e12a-6c5f-455d-ab3e-c3c150d3a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:44.654356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e12a-6c5f-455d-ab3e-c3c150d3a308 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.654731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e12a-6c5f-455d-ab3e-c3c150d3a308 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.655159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e12a-6c5f-455d-ab3e-c3c150d3a308 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.657127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:44.658004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.658530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.659017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.659962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:44.660450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:44.662041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:44.668741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526e12a-6c5f-455d-ab3e-c3c150d3a308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:44.672772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 116/226] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-6526e12a-6c5f-455d-ab3e-c3c150d3a308 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:44.673558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:44.674386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:44.675230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 111/227] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:44.680344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.685405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526e12a-6c5f-455d-ab3e-c3c150d3a308 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.706082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:44.771293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:44.814038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526e12a-6c5f-455d-ab3e-c3c150d3a308 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:44.821175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc99129-c7b4-483a-bd65-431832b4722d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:44.850879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:44.851536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.852154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.852154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.852788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:44.853095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:44.854644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:44.863651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 112/228] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:44.868904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.879262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3b0b-144d-4e39-9a21-ed0f93c7c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:44.879919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3b0b-144d-4e39-9a21-ed0f93c7c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:44.880201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3b0b-144d-4e39-9a21-ed0f93c7c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:44.880479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e3b0b-144d-4e39-9a21-ed0f93c7c5c6 None admin] PATH_INFO: `/v3/users/8a81e6a5759749a7b20c04dc07d3eacf` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:44.882169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e3b0b-144d-4e39-9a21-ed0f93c7c5c6 None admin] RBAC: Authorizing `identity:get_user(user_id=8a81e6a5759749a7b20c04dc07d3eacf)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:44.883727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e3b0b-144d-4e39-9a21-ed0f93c7c5c6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:44.885990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 117/229] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/users/8a81e6a5759749a7b20c04dc07d3eacf => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:44.892035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3b0b-144d-4e39-9a21-ed0f93c7c5c6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:44.995121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:45.033343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e3b0b-144d-4e39-9a21-ed0f93c7c5c6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:45.086627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfcab4-8b06-4db7-a7ce-c27493bfef47 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:45.101401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:45.109007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c25e9a-99a9-4140-8640-6d874c0eceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:45.109676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25e9a-99a9-4140-8640-6d874c0eceeb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:45.109967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25e9a-99a9-4140-8640-6d874c0eceeb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:45.110243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25e9a-99a9-4140-8640-6d874c0eceeb None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:45.115668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c25e9a-99a9-4140-8640-6d874c0eceeb None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:45.117156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c25e9a-99a9-4140-8640-6d874c0eceeb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:45.119760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 118/230] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:45.126072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c25e9a-99a9-4140-8640-6d874c0eceeb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:45.129935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42edea-374e-4185-b977-a32e9734f674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:45.130781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42edea-374e-4185-b977-a32e9734f674 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:45.131247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42edea-374e-4185-b977-a32e9734f674 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:45.131818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42edea-374e-4185-b977-a32e9734f674 None admin] PATH_INFO: `/v3/users/8a81e6a5759749a7b20c04dc07d3eacf` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:45.133363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42edea-374e-4185-b977-a32e9734f674 None admin] RBAC: Authorizing `identity:get_user(user_id=8a81e6a5759749a7b20c04dc07d3eacf)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:45.135857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42edea-374e-4185-b977-a32e9734f674 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:45.137952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 113/231] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:44 2022] GET /identity/v3/users/8a81e6a5759749a7b20c04dc07d3eacf => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:45.146979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42edea-374e-4185-b977-a32e9734f674 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:45.339318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c25e9a-99a9-4140-8640-6d874c0eceeb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:45.354808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42edea-374e-4185-b977-a32e9734f674 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:45.402875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b9748-4bde-4be0-aae0-7ba7aa0ce806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:45.403835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b9748-4bde-4be0-aae0-7ba7aa0ce806 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:45.404209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b9748-4bde-4be0-aae0-7ba7aa0ce806 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:45.404601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b9748-4bde-4be0-aae0-7ba7aa0ce806 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4/users/8a81e6a5759749a7b20c04dc07d3eacf/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:45.406763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b9748-4bde-4be0-aae0-7ba7aa0ce806 None admin] RBAC: Authorizing `identity:create_grant(project_id=273944e75b144a7dac98dfa191ba1fa4, user_id=8a81e6a5759749a7b20c04dc07d3eacf, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:45.408805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b9748-4bde-4be0-aae0-7ba7aa0ce806 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:45.409753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016aed6-7d19-433b-a798-894a57d41182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:45.410402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016aed6-7d19-433b-a798-894a57d41182 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:45.410689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016aed6-7d19-433b-a798-894a57d41182 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:45.410990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016aed6-7d19-433b-a798-894a57d41182 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:45.412172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016aed6-7d19-433b-a798-894a57d41182 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:45.413649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016aed6-7d19-433b-a798-894a57d41182 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:45.415942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 114/232] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:45 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:45.421345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016aed6-7d19-433b-a798-894a57d41182 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:45.435144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 119/233] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:45 2022] PUT /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4/users/8a81e6a5759749a7b20c04dc07d3eacf/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:38:45.480509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:45.535909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016aed6-7d19-433b-a798-894a57d41182 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:45.574433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57226cb9-27e5-4b34-b7d7-735d341c7a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:45.575144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226cb9-27e5-4b34-b7d7-735d341c7a3a None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:45.575425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226cb9-27e5-4b34-b7d7-735d341c7a3a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:45.575696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57226cb9-27e5-4b34-b7d7-735d341c7a3a None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4/users/8a81e6a5759749a7b20c04dc07d3eacf/roles/b1f864ecbe4c43b4a5a708fa216488d4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:45.577946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57226cb9-27e5-4b34-b7d7-735d341c7a3a None admin] RBAC: Authorizing `identity:create_grant(project_id=273944e75b144a7dac98dfa191ba1fa4, user_id=8a81e6a5759749a7b20c04dc07d3eacf, role_id=b1f864ecbe4c43b4a5a708fa216488d4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:45.579536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57226cb9-27e5-4b34-b7d7-735d341c7a3a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:45.599320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 115/234] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:45 2022] PUT /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4/users/8a81e6a5759749a7b20c04dc07d3eacf/roles/b1f864ecbe4c43b4a5a708fa216488d4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:46.152672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c59e6-0a3a-46a8-8e4e-d44f214d00e3 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:46.153190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c59e6-0a3a-46a8-8e4e-d44f214d00e3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:46.153265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c59e6-0a3a-46a8-8e4e-d44f214d00e3 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:46.154712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 120/235] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:46.160089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ece96-8679-4d0f-90fa-e52787996a27 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:46.160403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ece96-8679-4d0f-90fa-e52787996a27 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:46.160646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ece96-8679-4d0f-90fa-e52787996a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:46.182152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-097ece96-8679-4d0f-90fa-e52787996a27 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:46.183358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-097ece96-8679-4d0f-90fa-e52787996a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:46.264292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 116/236] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:46.300737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c59e6-0a3a-46a8-8e4e-d44f214d00e3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:46.310989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:46.312227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18973-3edb-4f09-97b6-2360451ad661 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:46.312512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18973-3edb-4f09-97b6-2360451ad661 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:46.312783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18973-3edb-4f09-97b6-2360451ad661 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:46.316137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 117/237] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:46.319256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec6c7-9958-4c60-8894-a81c75c09060 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:46.320308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec6c7-9958-4c60-8894-a81c75c09060 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:46.320584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec6c7-9958-4c60-8894-a81c75c09060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:46.352121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-bf9ec6c7-9958-4c60-8894-a81c75c09060 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:46.353955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-bf9ec6c7-9958-4c60-8894-a81c75c09060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:46.432320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:46.487241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c59e6-0a3a-46a8-8e4e-d44f214d00e3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:46.497482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 118/238] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:46.527255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2304-2516-4fb6-9932-b86372a45635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:46.527894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2304-2516-4fb6-9932-b86372a45635 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:46.528173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2304-2516-4fb6-9932-b86372a45635 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:46.528444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2304-2516-4fb6-9932-b86372a45635 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:46.529579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f2304-2516-4fb6-9932-b86372a45635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:46.531056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f2304-2516-4fb6-9932-b86372a45635 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:46.532848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 121/239] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:46.533694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ec6c7-9958-4c60-8894-a81c75c09060 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:46.538763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2304-2516-4fb6-9932-b86372a45635 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:46.625138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:46.654355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2304-2516-4fb6-9932-b86372a45635 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:46.702093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e212a-d3d1-4c17-8e22-767dabd1dd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:46.703040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e212a-d3d1-4c17-8e22-767dabd1dd0c None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:46.706134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e212a-d3d1-4c17-8e22-767dabd1dd0c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:46.706640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e212a-d3d1-4c17-8e22-767dabd1dd0c None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:46.707565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e212a-d3d1-4c17-8e22-767dabd1dd0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:46.709293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e212a-d3d1-4c17-8e22-767dabd1dd0c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:46.740412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 122/240] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:38:46 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:46.761545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ec6c7-9958-4c60-8894-a81c75c09060 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:46.817168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9f8a8-a91c-43ac-94e7-57929f9bd573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:46.817846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9f8a8-a91c-43ac-94e7-57929f9bd573 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:46.818130 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9f8a8-a91c-43ac-94e7-57929f9bd573 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:46.818404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9f8a8-a91c-43ac-94e7-57929f9bd573 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:46.833757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9f8a8-a91c-43ac-94e7-57929f9bd573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-12b9f8a8-a91c-43ac-94e7-57929f9bd573 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:46.839107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:46.840019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:46.840808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 119/241] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:46.856128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e212a-d3d1-4c17-8e22-767dabd1dd0c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:46.972349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e212a-d3d1-4c17-8e22-767dabd1dd0c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:47.002892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:47.011221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03b5f0-c816-474a-9e96-3301e5e97927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:47.012119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b5f0-c816-474a-9e96-3301e5e97927 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.012611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b5f0-c816-474a-9e96-3301e5e97927 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.013076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b5f0-c816-474a-9e96-3301e5e97927 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.013988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03b5f0-c816-474a-9e96-3301e5e97927 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:47.014497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03b5f0-c816-474a-9e96-3301e5e97927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:47.016103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03b5f0-c816-474a-9e96-3301e5e97927 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:47.026802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 123/242] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:47.032953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9f8a8-a91c-43ac-94e7-57929f9bd573 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:47.077238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:47.094557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43c9d6-54a9-45c1-a156-6384f869f7e4 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.094873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43c9d6-54a9-45c1-a156-6384f869f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.095141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43c9d6-54a9-45c1-a156-6384f869f7e4 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.096757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 124/243] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:47.101604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4dff3-9155-4d72-b13a-f7b0818da99f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.102119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4dff3-9155-4d72-b13a-f7b0818da99f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.102244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4dff3-9155-4d72-b13a-f7b0818da99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.127415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8fb4dff3-9155-4d72-b13a-f7b0818da99f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:47.128617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8fb4dff3-9155-4d72-b13a-f7b0818da99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:47.172803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9f8a8-a91c-43ac-94e7-57929f9bd573 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:47.212160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 125/244] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:47.214883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa029c-43de-4815-9799-98a96fe1c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:47.215698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa029c-43de-4815-9799-98a96fe1c6a6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.216037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa029c-43de-4815-9799-98a96fe1c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.216398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa029c-43de-4815-9799-98a96fe1c6a6 None admin] PATH_INFO: `/v3/users/ce448e0b8d334f259bc53b394b4a569c` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.232511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa029c-43de-4815-9799-98a96fe1c6a6 None admin] RBAC: Authorizing `identity:get_user(user_id=ce448e0b8d334f259bc53b394b4a569c)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:47.233913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa029c-43de-4815-9799-98a96fe1c6a6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:47.235714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 120/245] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:47 2022] GET /identity/v3/users/ce448e0b8d334f259bc53b394b4a569c => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:47.241235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4dff3-9155-4d72-b13a-f7b0818da99f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:47.245935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa029c-43de-4815-9799-98a96fe1c6a6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:47.370506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:47.375205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4dff3-9155-4d72-b13a-f7b0818da99f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:47.389406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa029c-43de-4815-9799-98a96fe1c6a6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:47.402434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:47.419619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f29d7-fb1e-49df-b0fd-67ea4b05baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:47.420673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f29d7-fb1e-49df-b0fd-67ea4b05baf7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.420961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f29d7-fb1e-49df-b0fd-67ea4b05baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.421238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f29d7-fb1e-49df-b0fd-67ea4b05baf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.432639 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3951081-24dc-4858-8f06-30b6bb018314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:47.433887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951081-24dc-4858-8f06-30b6bb018314 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.434359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951081-24dc-4858-8f06-30b6bb018314 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.435027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951081-24dc-4858-8f06-30b6bb018314 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.451547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3951081-24dc-4858-8f06-30b6bb018314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-e3951081-24dc-4858-8f06-30b6bb018314 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:47.458719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:47.459711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:47.460486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 121/246] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:47.467436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3951081-24dc-4858-8f06-30b6bb018314 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:47.505034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f29d7-fb1e-49df-b0fd-67ea4b05baf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:47.506826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f29d7-fb1e-49df-b0fd-67ea4b05baf7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:47.575806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3951081-24dc-4858-8f06-30b6bb018314 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:47.611615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:47.612291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.612515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.612790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.613510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:47.613810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:47.615232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:47.618766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 126/247] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:47.628961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 122/248] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:47.629813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f29d7-fb1e-49df-b0fd-67ea4b05baf7 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:47.642363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:47.659615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:47.677185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:47.810330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f29d7-fb1e-49df-b0fd-67ea4b05baf7 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:47.821698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047baf2-f0c6-4a11-9857-1746837bf111 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:47.874245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a4df9-f45c-46f7-9afa-bef95a8e455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:47.874902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a4df9-f45c-46f7-9afa-bef95a8e455e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.875204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a4df9-f45c-46f7-9afa-bef95a8e455e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.875477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a4df9-f45c-46f7-9afa-bef95a8e455e None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.877093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a4df9-f45c-46f7-9afa-bef95a8e455e None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:47.878536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a4df9-f45c-46f7-9afa-bef95a8e455e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:47.881990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 127/249] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:47 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:47.882691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ac9d-4ba7-4e21-8c85-1a548f9d56d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:47.887530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ac9d-4ba7-4e21-8c85-1a548f9d56d5 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:47.887814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ac9d-4ba7-4e21-8c85-1a548f9d56d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:47.888092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ac9d-4ba7-4e21-8c85-1a548f9d56d5 None admin] PATH_INFO: `/v3/users/8378ec22986f496db9bf371b85a305f7` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:47.889386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ac9d-4ba7-4e21-8c85-1a548f9d56d5 None admin] RBAC: Authorizing `identity:get_user(user_id=8378ec22986f496db9bf371b85a305f7)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:47.890843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ac9d-4ba7-4e21-8c85-1a548f9d56d5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:47.892778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 123/250] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:47 2022] GET /identity/v3/users/8378ec22986f496db9bf371b85a305f7 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:47.898396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a4df9-f45c-46f7-9afa-bef95a8e455e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:47.904099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ac9d-4ba7-4e21-8c85-1a548f9d56d5 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:48.063365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:48.087200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a4df9-f45c-46f7-9afa-bef95a8e455e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:48.099512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:48.139649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5bba-5f9d-45ff-a11d-6c23939bb523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:48.140311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5bba-5f9d-45ff-a11d-6c23939bb523 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.140599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5bba-5f9d-45ff-a11d-6c23939bb523 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.140876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5bba-5f9d-45ff-a11d-6c23939bb523 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.142112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f5bba-5f9d-45ff-a11d-6c23939bb523 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:48.143611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f5bba-5f9d-45ff-a11d-6c23939bb523 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:48.147706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ac9d-4ba7-4e21-8c85-1a548f9d56d5 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:48.150009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 128/251] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:47 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:48.155863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5bba-5f9d-45ff-a11d-6c23939bb523 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:48.260793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bd3d8-51ec-4a1f-ba6d-311382c9fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:48.262078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd3d8-51ec-4a1f-ba6d-311382c9fa38 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.262612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd3d8-51ec-4a1f-ba6d-311382c9fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.263348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd3d8-51ec-4a1f-ba6d-311382c9fa38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.265088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bd3d8-51ec-4a1f-ba6d-311382c9fa38 None admin] RBAC: Adding query filter params (role.id=bc25d3d5fc6a4fb19a587d70e771145d, scope.project.id=273944e75b144a7dac98dfa191ba1fa4, user.id=ce448e0b8d334f259bc53b394b4a569c) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:48.265623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bd3d8-51ec-4a1f-ba6d-311382c9fa38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:48.267891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bd3d8-51ec-4a1f-ba6d-311382c9fa38 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:48.274628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 124/252] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:47 2022] GET /identity/v3/role_assignments?user.id=ce448e0b8d334f259bc53b394b4a569c&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=bc25d3d5fc6a4fb19a587d70e771145d => generated 259 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:48.276358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5bba-5f9d-45ff-a11d-6c23939bb523 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:48.276812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712fb24-6f18-492d-8536-74e9c1ee1511 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.276891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712fb24-6f18-492d-8536-74e9c1ee1511 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.277120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712fb24-6f18-492d-8536-74e9c1ee1511 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.278754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 125/253] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:48.280103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f45b1-bad7-4c3f-ab84-c16d0265230e None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.280393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f45b1-bad7-4c3f-ab84-c16d0265230e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.280679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f45b1-bad7-4c3f-ab84-c16d0265230e None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.281997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 126/254] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:48.286085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9e7b6-dcc3-433a-9b12-14f2256e1ab4 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.286085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9e7b6-dcc3-433a-9b12-14f2256e1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.286085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9e7b6-dcc3-433a-9b12-14f2256e1ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.304200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-fdf9e7b6-dcc3-433a-9b12-14f2256e1ab4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:48.305596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-fdf9e7b6-dcc3-433a-9b12-14f2256e1ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:48.332613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387285d-5e52-4cfd-b478-516f413b478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:48.334115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387285d-5e52-4cfd-b478-516f413b478d None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.334995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387285d-5e52-4cfd-b478-516f413b478d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.335429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387285d-5e52-4cfd-b478-516f413b478d None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4/users/8378ec22986f496db9bf371b85a305f7/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.339272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387285d-5e52-4cfd-b478-516f413b478d None admin] RBAC: Authorizing `identity:create_grant(project_id=273944e75b144a7dac98dfa191ba1fa4, user_id=8378ec22986f496db9bf371b85a305f7, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:48.341717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387285d-5e52-4cfd-b478-516f413b478d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:48.376291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 129/255] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:48 2022] PUT /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4/users/8378ec22986f496db9bf371b85a305f7/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:38:48.378793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e565-0eaa-4fb7-87a5-57280eedebad None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.379108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e565-0eaa-4fb7-87a5-57280eedebad None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.379386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e565-0eaa-4fb7-87a5-57280eedebad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.415481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 127/256] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:48.417123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-71d4e565-0eaa-4fb7-87a5-57280eedebad None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:48.418370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-71d4e565-0eaa-4fb7-87a5-57280eedebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:48.434989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:48.446256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9e7b6-dcc3-433a-9b12-14f2256e1ab4 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:48.530410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 130/257] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:48.557414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:48.568410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e565-0eaa-4fb7-87a5-57280eedebad None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:48.609599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9e7b6-dcc3-433a-9b12-14f2256e1ab4 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:48.656124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04ac6f-b0e8-49b2-b8ba-2034a3572984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:48.656795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ac6f-b0e8-49b2-b8ba-2034a3572984 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.657080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ac6f-b0e8-49b2-b8ba-2034a3572984 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.657357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ac6f-b0e8-49b2-b8ba-2034a3572984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.668601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04ac6f-b0e8-49b2-b8ba-2034a3572984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-8d04ac6f-b0e8-49b2-b8ba-2034a3572984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:48.673673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:48.674545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:48.675378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 128/258] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:38:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:48.681180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04ac6f-b0e8-49b2-b8ba-2034a3572984 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:48.790467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04ac6f-b0e8-49b2-b8ba-2034a3572984 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:48.812895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e565-0eaa-4fb7-87a5-57280eedebad None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:48.823393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:48.827867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:48.828496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.828775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.829051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.829765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:48.830069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:48.831581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:48.840961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 129/259] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:48.867302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:48.871520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832e54e-35da-4db4-84d1-4b5d56783a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:48.872184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e54e-35da-4db4-84d1-4b5d56783a1a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:48.872466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e54e-35da-4db4-84d1-4b5d56783a1a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:48.872743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e54e-35da-4db4-84d1-4b5d56783a1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:48.883549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832e54e-35da-4db4-84d1-4b5d56783a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-9832e54e-35da-4db4-84d1-4b5d56783a1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:48.889265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:48.890174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:48.891059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 131/260] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:38:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:48.899885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832e54e-35da-4db4-84d1-4b5d56783a1a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:48.919330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:49.049841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832e54e-35da-4db4-84d1-4b5d56783a1a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:49.102957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:49.102957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:49.102957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:49.102957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:49.103888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:49.103888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:49.104637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:49.118576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 132/261] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:38:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:49.127041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:49.134719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cb1ee-6701-444a-8816-1c38258c959a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:49.212097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7d31c-5b04-493f-8614-a49ef62abff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:49.212781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7d31c-5b04-493f-8614-a49ef62abff9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:49.213066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7d31c-5b04-493f-8614-a49ef62abff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:49.213344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7d31c-5b04-493f-8614-a49ef62abff9 None admin] PATH_INFO: `/v3/users/8a81e6a5759749a7b20c04dc07d3eacf` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:49.214564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7d31c-5b04-493f-8614-a49ef62abff9 None admin] RBAC: Authorizing `identity:get_user(user_id=8a81e6a5759749a7b20c04dc07d3eacf)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:49.216043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7d31c-5b04-493f-8614-a49ef62abff9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:49.217873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 130/262] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:48 2022] GET /identity/v3/users/8a81e6a5759749a7b20c04dc07d3eacf => generated 283 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:49.223240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7d31c-5b04-493f-8614-a49ef62abff9 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:49.253451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:49.315487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:49.333385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc29e4-86c6-4e58-bc94-2c1310cf3298 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:49.370415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7d31c-5b04-493f-8614-a49ef62abff9 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:49.389843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fa7cf-2ffe-496c-8b2b-b22de25ec1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:49.390878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fa7cf-2ffe-496c-8b2b-b22de25ec1b3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:49.391379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fa7cf-2ffe-496c-8b2b-b22de25ec1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:49.391839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fa7cf-2ffe-496c-8b2b-b22de25ec1b3 None admin] PATH_INFO: `/v3/users/8a81e6a5759749a7b20c04dc07d3eacf` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:49.395891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fa7cf-2ffe-496c-8b2b-b22de25ec1b3 None admin] RBAC: Authorizing `identity:get_user(user_id=8a81e6a5759749a7b20c04dc07d3eacf)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:49.397718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fa7cf-2ffe-496c-8b2b-b22de25ec1b3 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:49.399785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 133/263] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:49 2022] GET /identity/v3/users/8a81e6a5759749a7b20c04dc07d3eacf => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:49.406361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fa7cf-2ffe-496c-8b2b-b22de25ec1b3 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:49.408607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec80c6-9413-43a8-a99c-bcd543b14f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:49.409341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec80c6-9413-43a8-a99c-bcd543b14f5d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:49.409723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec80c6-9413-43a8-a99c-bcd543b14f5d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:49.410097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec80c6-9413-43a8-a99c-bcd543b14f5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:49.529239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec80c6-9413-43a8-a99c-bcd543b14f5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:49.531171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec80c6-9413-43a8-a99c-bcd543b14f5d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:49.606025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:49.608269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fa7cf-2ffe-496c-8b2b-b22de25ec1b3 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:49.646739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e84902-e937-4712-8ada-7c7c1a55a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:49.647622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84902-e937-4712-8ada-7c7c1a55a90d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:49.648139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84902-e937-4712-8ada-7c7c1a55a90d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:49.648560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84902-e937-4712-8ada-7c7c1a55a90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:49.658461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:49.694153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 131/264] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 07:38:49.700234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec80c6-9413-43a8-a99c-bcd543b14f5d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:49.726806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e84902-e937-4712-8ada-7c7c1a55a90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:49.728733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e84902-e937-4712-8ada-7c7c1a55a90d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:49.843267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 134/265] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 07:38:49.849007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e84902-e937-4712-8ada-7c7c1a55a90d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:49.891907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:49.935947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec80c6-9413-43a8-a99c-bcd543b14f5d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:49.960240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e84902-e937-4712-8ada-7c7c1a55a90d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:49.996236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296158d3-07e0-4a53-aab6-1a78499e7d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:49.997172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296158d3-07e0-4a53-aab6-1a78499e7d73 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:49.997672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296158d3-07e0-4a53-aab6-1a78499e7d73 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:49.998247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296158d3-07e0-4a53-aab6-1a78499e7d73 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:49.998661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a9e58-07a0-4df3-81cf-22108bdb3c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:49.999603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a9e58-07a0-4df3-81cf-22108bdb3c48 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.000082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a9e58-07a0-4df3-81cf-22108bdb3c48 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.000530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a9e58-07a0-4df3-81cf-22108bdb3c48 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.000750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296158d3-07e0-4a53-aab6-1a78499e7d73 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:50.002296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a9e58-07a0-4df3-81cf-22108bdb3c48 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:50.002615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296158d3-07e0-4a53-aab6-1a78499e7d73 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:50.004105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a9e58-07a0-4df3-81cf-22108bdb3c48 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:50.004563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 132/266] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:49 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:50.006347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 135/267] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:49 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:50.010894 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296158d3-07e0-4a53-aab6-1a78499e7d73 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:50.012881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a9e58-07a0-4df3-81cf-22108bdb3c48 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:50.071342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:50.127159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a9e58-07a0-4df3-81cf-22108bdb3c48 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:50.136335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:50.166967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4adbb-5fff-48ba-9a38-22dc579f7185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:50.167915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4adbb-5fff-48ba-9a38-22dc579f7185 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.168346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4adbb-5fff-48ba-9a38-22dc579f7185 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.168795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4adbb-5fff-48ba-9a38-22dc579f7185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.169730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4adbb-5fff-48ba-9a38-22dc579f7185 None admin] RBAC: Adding query filter params (role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=273944e75b144a7dac98dfa191ba1fa4, user.id=8a81e6a5759749a7b20c04dc07d3eacf) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:50.170189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4adbb-5fff-48ba-9a38-22dc579f7185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:50.171810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4adbb-5fff-48ba-9a38-22dc579f7185 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:50.178894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 136/268] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:50 2022] GET /identity/v3/role_assignments?user.id=8a81e6a5759749a7b20c04dc07d3eacf&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:50.213648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296158d3-07e0-4a53-aab6-1a78499e7d73 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:50.257202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23855a4-1482-44ff-a678-2e2d1318203b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.257767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23855a4-1482-44ff-a678-2e2d1318203b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.258250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23855a4-1482-44ff-a678-2e2d1318203b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.260645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 137/269] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:50.266902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797889f5-86b4-4557-b3ae-81145e3b984c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.267222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797889f5-86b4-4557-b3ae-81145e3b984c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.267504 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797889f5-86b4-4557-b3ae-81145e3b984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.271249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83d865-70b7-4b94-ae14-be10313d0549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:50.271900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d865-70b7-4b94-ae14-be10313d0549 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.272181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d865-70b7-4b94-ae14-be10313d0549 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.272455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d865-70b7-4b94-ae14-be10313d0549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.273273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83d865-70b7-4b94-ae14-be10313d0549 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=273944e75b144a7dac98dfa191ba1fa4, user.id=8a81e6a5759749a7b20c04dc07d3eacf) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:50.273586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83d865-70b7-4b94-ae14-be10313d0549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:50.275185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83d865-70b7-4b94-ae14-be10313d0549 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:50.290735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 133/270] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:50 2022] GET /identity/v3/role_assignments?user.id=8a81e6a5759749a7b20c04dc07d3eacf&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=53894f3146884908ba6dd3e118397fb3 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:50.297707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-797889f5-86b4-4557-b3ae-81145e3b984c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:50.299028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-797889f5-86b4-4557-b3ae-81145e3b984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:50.401221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 138/271] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:50.422088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afa65a-37e1-41fd-8875-d3aa04b335bc None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.422387 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afa65a-37e1-41fd-8875-d3aa04b335bc None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.422647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afa65a-37e1-41fd-8875-d3aa04b335bc None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.424187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 134/272] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:50.429475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60d27-a767-4c40-bb6b-ca3916dd0742 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.429770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60d27-a767-4c40-bb6b-ca3916dd0742 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.430051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60d27-a767-4c40-bb6b-ca3916dd0742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.442119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afa65a-37e1-41fd-8875-d3aa04b335bc None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:50.450515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-91a60d27-a767-4c40-bb6b-ca3916dd0742 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:50.451752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-91a60d27-a767-4c40-bb6b-ca3916dd0742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:50.560308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 139/273] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:50.585709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a60d27-a767-4c40-bb6b-ca3916dd0742 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:50.598263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:50.615511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afa65a-37e1-41fd-8875-d3aa04b335bc None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:50.628553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:50.661497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff81cf-9026-4603-ac41-bb836e9c344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:50.662158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff81cf-9026-4603-ac41-bb836e9c344d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.662442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff81cf-9026-4603-ac41-bb836e9c344d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.662719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff81cf-9026-4603-ac41-bb836e9c344d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.664123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff81cf-9026-4603-ac41-bb836e9c344d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:50.665366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff81cf-9026-4603-ac41-bb836e9c344d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:50.669947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 135/274] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:50.674900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff81cf-9026-4603-ac41-bb836e9c344d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:50.719942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a60d27-a767-4c40-bb6b-ca3916dd0742 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:50.756487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06fb5d-1517-405b-b424-9c72d6c018f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:50.757150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06fb5d-1517-405b-b424-9c72d6c018f8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.757587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06fb5d-1517-405b-b424-9c72d6c018f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.757692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06fb5d-1517-405b-b424-9c72d6c018f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.770653 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06fb5d-1517-405b-b424-9c72d6c018f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-cb06fb5d-1517-405b-b424-9c72d6c018f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:50.775861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:50.776752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:50.777524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:50.782527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 140/275] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:50.783522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06fb5d-1517-405b-b424-9c72d6c018f8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:50.808519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff81cf-9026-4603-ac41-bb836e9c344d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:50.851021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971dda3-948d-47ce-90df-54fd7d146243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:50.851638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971dda3-948d-47ce-90df-54fd7d146243 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.851855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971dda3-948d-47ce-90df-54fd7d146243 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.852131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971dda3-948d-47ce-90df-54fd7d146243 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.852859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971dda3-948d-47ce-90df-54fd7d146243 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:50.854963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971dda3-948d-47ce-90df-54fd7d146243 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:50.883151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 136/276] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:38:50 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:50.891350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:50.903781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06fb5d-1517-405b-b424-9c72d6c018f8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:50.943149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:50.944142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:50.944622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:50.945123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:50.946082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:50.946599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:50.948363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:50.963071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 141/277] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:50.965336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971dda3-948d-47ce-90df-54fd7d146243 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:50.987587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:51.080444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971dda3-948d-47ce-90df-54fd7d146243 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:51.117306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781932d-739b-4989-a064-372df0a16f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:51.118292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781932d-739b-4989-a064-372df0a16f59 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.118824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781932d-739b-4989-a064-372df0a16f59 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.119314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781932d-739b-4989-a064-372df0a16f59 None admin] PATH_INFO: `/v3/users/d2f2c1cf096747f3bac12e6de75cb102` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.133540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781932d-739b-4989-a064-372df0a16f59 None admin] RBAC: Authorizing `identity:get_user(user_id=d2f2c1cf096747f3bac12e6de75cb102)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:51.135300 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781932d-739b-4989-a064-372df0a16f59 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:51.140793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 137/278] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:50 2022] GET /identity/v3/users/d2f2c1cf096747f3bac12e6de75cb102 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:51.143603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:51.198049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab12efb-f8c2-4f98-9081-b58115b85911 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.198701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab12efb-f8c2-4f98-9081-b58115b85911 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.199343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab12efb-f8c2-4f98-9081-b58115b85911 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.201557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 138/279] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:51.206365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69f80-2ff9-4231-8298-91f30906529f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.207088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69f80-2ff9-4231-8298-91f30906529f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.207088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69f80-2ff9-4231-8298-91f30906529f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.232004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-69d69f80-2ff9-4231-8298-91f30906529f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:51.233213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-69d69f80-2ff9-4231-8298-91f30906529f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:51.271113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfde43-0c4b-4899-9e4d-355e1e766ff1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:51.312149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b91a0-7cfd-4dd6-a1d4-09b146c97ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:51.313024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b91a0-7cfd-4dd6-a1d4-09b146c97ce3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.313308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b91a0-7cfd-4dd6-a1d4-09b146c97ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.313588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b91a0-7cfd-4dd6-a1d4-09b146c97ce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.314386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b91a0-7cfd-4dd6-a1d4-09b146c97ce3 None admin] RBAC: Adding query filter params (role.id=76ec473c1ae74b7880a67166a2fe69ab, user.id=d2f2c1cf096747f3bac12e6de75cb102, scope.system=all) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:51.314727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b91a0-7cfd-4dd6-a1d4-09b146c97ce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:51.316192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b91a0-7cfd-4dd6-a1d4-09b146c97ce3 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:51.316378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 139/280] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:51.322429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 142/281] 10.222.0.46 () {56 vars in 1308 bytes} [Tue Jul 26 07:38:51 2022] GET /identity/v3/role_assignments?user.id=d2f2c1cf096747f3bac12e6de75cb102&scope.system=all&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:51.342359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d69f80-2ff9-4231-8298-91f30906529f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:51.352068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:51.428894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb5941-0e23-4d9e-9ffb-5add0afffb9d None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.429414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb5941-0e23-4d9e-9ffb-5add0afffb9d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.429488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb5941-0e23-4d9e-9ffb-5add0afffb9d None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.431120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 143/282] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:51.436712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fd083-f8f1-465f-a616-da15717ff6f4 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.437000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fd083-f8f1-465f-a616-da15717ff6f4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.437280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fd083-f8f1-465f-a616-da15717ff6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.463417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c15fd083-f8f1-465f-a616-da15717ff6f4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:51.464649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c15fd083-f8f1-465f-a616-da15717ff6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:51.483176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:51.505626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d69f80-2ff9-4231-8298-91f30906529f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:51.555123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685ed48-c369-4206-b4a0-b1fd9f1abfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:51.556760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ed48-c369-4206-b4a0-b1fd9f1abfe1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.557247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ed48-c369-4206-b4a0-b1fd9f1abfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.557719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ed48-c369-4206-b4a0-b1fd9f1abfe1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.569942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 144/283] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:51.580547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685ed48-c369-4206-b4a0-b1fd9f1abfe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-9685ed48-c369-4206-b4a0-b1fd9f1abfe1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:51.585666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:51.586528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:51.587930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 140/284] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:51.592747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fd083-f8f1-465f-a616-da15717ff6f4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:51.608221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685ed48-c369-4206-b4a0-b1fd9f1abfe1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:51.729815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:51.749729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fd083-f8f1-465f-a616-da15717ff6f4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:51.790909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:51.792356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.792975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.793447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.794362 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:51.794889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:51.796892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:51.806842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 145/285] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:51.812321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:51.815285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685ed48-c369-4206-b4a0-b1fd9f1abfe1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:51.837444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:51.862308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d129e-2668-4e7c-825e-c70072c4a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:51.863291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d129e-2668-4e7c-825e-c70072c4a94e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:51.863925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d129e-2668-4e7c-825e-c70072c4a94e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:51.864396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d129e-2668-4e7c-825e-c70072c4a94e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:51.876558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d129e-2668-4e7c-825e-c70072c4a94e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-ef0d129e-2668-4e7c-825e-c70072c4a94e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:51.882286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:51.883159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:51.883960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:51.887434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 141/286] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:51.896231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d129e-2668-4e7c-825e-c70072c4a94e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:51.998981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e084529-3ac5-4301-a798-bd2c13dbc2c4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:52.023659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d129e-2668-4e7c-825e-c70072c4a94e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:52.067296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:52.073104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea25aa-637c-4280-90d0-ba269ef30c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:52.073770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea25aa-637c-4280-90d0-ba269ef30c55 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:52.074054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea25aa-637c-4280-90d0-ba269ef30c55 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:52.074329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea25aa-637c-4280-90d0-ba269ef30c55 None admin] PATH_INFO: `/v3/users/ce448e0b8d334f259bc53b394b4a569c` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:52.075960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea25aa-637c-4280-90d0-ba269ef30c55 None admin] RBAC: Authorizing `identity:get_user(user_id=ce448e0b8d334f259bc53b394b4a569c)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:52.077414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea25aa-637c-4280-90d0-ba269ef30c55 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:52.079254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 146/287] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:51 2022] GET /identity/v3/users/ce448e0b8d334f259bc53b394b4a569c => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:52.082394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:52.083046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:52.083333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:52.083614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:52.084349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:52.084659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:52.086024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:52.088218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea25aa-637c-4280-90d0-ba269ef30c55 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:52.105462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 142/288] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:52.110758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:52.235868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14205a5-3f36-4065-a9e9-59cf9f4c39ae None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:52.245583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:52.271789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71901155-4754-4cc5-be63-12bba0500544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:52.272362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71901155-4754-4cc5-be63-12bba0500544 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:52.272647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71901155-4754-4cc5-be63-12bba0500544 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:52.272928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71901155-4754-4cc5-be63-12bba0500544 None admin] PATH_INFO: `/v3/users/8378ec22986f496db9bf371b85a305f7` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:52.274117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71901155-4754-4cc5-be63-12bba0500544 None admin] RBAC: Authorizing `identity:get_user(user_id=8378ec22986f496db9bf371b85a305f7)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:52.275649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71901155-4754-4cc5-be63-12bba0500544 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:52.278216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 143/289] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:52 2022] GET /identity/v3/users/8378ec22986f496db9bf371b85a305f7 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:52.283845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71901155-4754-4cc5-be63-12bba0500544 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:52.301520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea25aa-637c-4280-90d0-ba269ef30c55 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:52.366341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a832-1b33-4a89-ba53-2e504d13813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:52.367015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a832-1b33-4a89-ba53-2e504d13813d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:52.367298 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a832-1b33-4a89-ba53-2e504d13813d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:52.367571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a832-1b33-4a89-ba53-2e504d13813d None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:52.369380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57a832-1b33-4a89-ba53-2e504d13813d None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:52.370825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57a832-1b33-4a89-ba53-2e504d13813d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:52.372524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 147/290] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:52 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:52.378778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a832-1b33-4a89-ba53-2e504d13813d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:52.395100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:52.505958 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a832-1b33-4a89-ba53-2e504d13813d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:52.536893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71901155-4754-4cc5-be63-12bba0500544 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:52.541311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8695d7-a946-4ee7-ae1e-d1b748514fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:52.542057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8695d7-a946-4ee7-ae1e-d1b748514fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:52.542409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8695d7-a946-4ee7-ae1e-d1b748514fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:52.542743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8695d7-a946-4ee7-ae1e-d1b748514fe4 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4/users/ce448e0b8d334f259bc53b394b4a569c/roles/bc25d3d5fc6a4fb19a587d70e771145d` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:52.544942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8695d7-a946-4ee7-ae1e-d1b748514fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=273944e75b144a7dac98dfa191ba1fa4, user_id=ce448e0b8d334f259bc53b394b4a569c, role_id=bc25d3d5fc6a4fb19a587d70e771145d)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:52.546462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8695d7-a946-4ee7-ae1e-d1b748514fe4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:52.571364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 148/291] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:38:52 2022] PUT /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4/users/ce448e0b8d334f259bc53b394b4a569c/roles/bc25d3d5fc6a4fb19a587d70e771145d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:52.595941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd1fb-6799-420f-a607-621d0f6a2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:52.596635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd1fb-6799-420f-a607-621d0f6a2b29 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:52.596920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd1fb-6799-420f-a607-621d0f6a2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:52.597212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd1fb-6799-420f-a607-621d0f6a2b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:52.685778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bd1fb-6799-420f-a607-621d0f6a2b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:52.687328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bd1fb-6799-420f-a607-621d0f6a2b29 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:52.754542 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:52.817907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 144/292] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:52.823949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8695d7-a946-4ee7-ae1e-d1b748514fe4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:52.831247 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:52.946680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8695d7-a946-4ee7-ae1e-d1b748514fe4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:52.985534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4474b7-0c71-404d-84c0-f76b3236ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:52.986199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4474b7-0c71-404d-84c0-f76b3236ab81 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:52.986481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4474b7-0c71-404d-84c0-f76b3236ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:52.986759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4474b7-0c71-404d-84c0-f76b3236ab81 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:52.991371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4474b7-0c71-404d-84c0-f76b3236ab81 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:52.992853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4474b7-0c71-404d-84c0-f76b3236ab81 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:52.994907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 149/293] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:52 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:53.000426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd1fb-6799-420f-a607-621d0f6a2b29 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:53.140721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd1fb-6799-420f-a607-621d0f6a2b29 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:53.176367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e397af5-8b1f-4b3f-8425-4adbb2fa8788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:53.177000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397af5-8b1f-4b3f-8425-4adbb2fa8788 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.177280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397af5-8b1f-4b3f-8425-4adbb2fa8788 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.177554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397af5-8b1f-4b3f-8425-4adbb2fa8788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.178352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e397af5-8b1f-4b3f-8425-4adbb2fa8788 None admin] RBAC: Adding query filter params (role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=273944e75b144a7dac98dfa191ba1fa4, user.id=8378ec22986f496db9bf371b85a305f7) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:53.178662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e397af5-8b1f-4b3f-8425-4adbb2fa8788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:53.180150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e397af5-8b1f-4b3f-8425-4adbb2fa8788 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:53.187185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 145/294] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:52 2022] GET /identity/v3/role_assignments?user.id=8378ec22986f496db9bf371b85a305f7&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:53.544282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93afc7-8224-4b0e-83c6-2401b64cb1f2 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.544790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93afc7-8224-4b0e-83c6-2401b64cb1f2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.544862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93afc7-8224-4b0e-83c6-2401b64cb1f2 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.546316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 150/295] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:53.551877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447f0d3-9a76-4c85-a611-a28c65135771 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.552386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447f0d3-9a76-4c85-a611-a28c65135771 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.552870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447f0d3-9a76-4c85-a611-a28c65135771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.569859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a75e-7f2d-4ef4-9130-ca09be53f94a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.570179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a75e-7f2d-4ef4-9130-ca09be53f94a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.570408 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066a75e-7f2d-4ef4-9130-ca09be53f94a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.572094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 151/296] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:53.575635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c447f0d3-9a76-4c85-a611-a28c65135771 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:53.576839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c447f0d3-9a76-4c85-a611-a28c65135771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:53.581040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba357-15ab-4b3f-87bb-60c1db1a915c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.581318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba357-15ab-4b3f-87bb-60c1db1a915c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.581593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba357-15ab-4b3f-87bb-60c1db1a915c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.597227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:53.617925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-803ba357-15ab-4b3f-87bb-60c1db1a915c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:53.620100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-803ba357-15ab-4b3f-87bb-60c1db1a915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:53.676860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 146/297] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:53.678791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4209-4542-4db3-8ebe-07969762baab None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.679317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4209-4542-4db3-8ebe-07969762baab None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.679788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4209-4542-4db3-8ebe-07969762baab None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.682038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 147/298] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:53.687172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4ab5-89ff-4eb8-a043-408ac5fb0b96 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.688128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4ab5-89ff-4eb8-a043-408ac5fb0b96 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.688601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4ab5-89ff-4eb8-a043-408ac5fb0b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.697758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 152/299] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:53.707898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ba357-15ab-4b3f-87bb-60c1db1a915c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:53.710394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:53.718687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b35a4ab5-89ff-4eb8-a043-408ac5fb0b96 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:53.720154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b35a4ab5-89ff-4eb8-a043-408ac5fb0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:53.793650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 148/300] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:53.794981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4ab5-89ff-4eb8-a043-408ac5fb0b96 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:53.819594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ba357-15ab-4b3f-87bb-60c1db1a915c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:53.862302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67166eb-958d-4e50-a63c-2d9e850cbce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:53.862972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67166eb-958d-4e50-a63c-2d9e850cbce4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.863258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67166eb-958d-4e50-a63c-2d9e850cbce4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.863530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67166eb-958d-4e50-a63c-2d9e850cbce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.864688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67166eb-958d-4e50-a63c-2d9e850cbce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:53.866111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67166eb-958d-4e50-a63c-2d9e850cbce4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:53.867891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 153/301] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:53.869293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67166eb-958d-4e50-a63c-2d9e850cbce4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:53.888334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:53.909722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4ab5-89ff-4eb8-a043-408ac5fb0b96 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:53.940559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:53.954292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcaced-f37e-447e-801b-a0eb626c415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:53.955241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcaced-f37e-447e-801b-a0eb626c415e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:53.955528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcaced-f37e-447e-801b-a0eb626c415e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:53.955800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcaced-f37e-447e-801b-a0eb626c415e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:53.968001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcaced-f37e-447e-801b-a0eb626c415e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:53.972547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67166eb-958d-4e50-a63c-2d9e850cbce4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-a4fcaced-f37e-447e-801b-a0eb626c415e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:53.973025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:53.973879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:53.974666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 149/302] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:53.975339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcaced-f37e-447e-801b-a0eb626c415e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:54.011644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0374e-ea26-41aa-b98c-f86edfdc4410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:54.012375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0374e-ea26-41aa-b98c-f86edfdc4410 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.012716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0374e-ea26-41aa-b98c-f86edfdc4410 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.012978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0374e-ea26-41aa-b98c-f86edfdc4410 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.025629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0374e-ea26-41aa-b98c-f86edfdc4410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-25d0374e-ea26-41aa-b98c-f86edfdc4410 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:54.031008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:54.031890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:54.032686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 154/303] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:54.033335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0374e-ea26-41aa-b98c-f86edfdc4410 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:54.087240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcaced-f37e-447e-801b-a0eb626c415e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:54.124431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f694f4-708c-42d7-8322-69d484175e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:54.125108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f694f4-708c-42d7-8322-69d484175e28 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.125395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f694f4-708c-42d7-8322-69d484175e28 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.125671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f694f4-708c-42d7-8322-69d484175e28 None admin] PATH_INFO: `/v3/groups` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.126359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f694f4-708c-42d7-8322-69d484175e28 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:54.127846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f694f4-708c-42d7-8322-69d484175e28 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:54.137952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0374e-ea26-41aa-b98c-f86edfdc4410 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:54.140706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:54.155026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 150/304] 10.222.0.46 () {60 vars in 1134 bytes} [Tue Jul 26 07:38:53 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:38:54.155026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f694f4-708c-42d7-8322-69d484175e28 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:54.182212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:54.190354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:54.191575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.192048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.192402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.193727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] RBAC: Adding query filter params (name=reader) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:54.194179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:54.197861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:54.209893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 155/305] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:54.215747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:54.277064 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f694f4-708c-42d7-8322-69d484175e28 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:54.318161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:54.319418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.320142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.320571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.321490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:54.322638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:54.324991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:54.336494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 151/306] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:54.342187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:54.356927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be66816-6595-4f46-9861-33c450ccafcc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:54.408218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9dd89-da6f-441b-8441-3f131edffdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:54.409208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9dd89-da6f-441b-8441-3f131edffdb0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.409497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9dd89-da6f-441b-8441-3f131edffdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.409778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9dd89-da6f-441b-8441-3f131edffdb0 None admin] PATH_INFO: `/v3/users/50cfa3d9ac814a609f521dfe41c1acf5` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.423308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:54.430964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9dd89-da6f-441b-8441-3f131edffdb0 None admin] RBAC: Authorizing `identity:get_user(user_id=50cfa3d9ac814a609f521dfe41c1acf5)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:54.432900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9dd89-da6f-441b-8441-3f131edffdb0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:54.436003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 156/307] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:54 2022] GET /identity/v3/users/50cfa3d9ac814a609f521dfe41c1acf5 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:54.442680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9dd89-da6f-441b-8441-3f131edffdb0 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:54.471899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99b7e4-648a-4a04-a1f1-953d69e2a6bb None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:54.510564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf96daa-035e-4176-83c7-59a54d5d9b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:54.511251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96daa-035e-4176-83c7-59a54d5d9b26 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.511536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96daa-035e-4176-83c7-59a54d5d9b26 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.511946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96daa-035e-4176-83c7-59a54d5d9b26 None admin] PATH_INFO: `/v3/users/d2f2c1cf096747f3bac12e6de75cb102` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.513279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf96daa-035e-4176-83c7-59a54d5d9b26 None admin] RBAC: Authorizing `identity:get_user(user_id=d2f2c1cf096747f3bac12e6de75cb102)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:54.515056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:54.516026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf96daa-035e-4176-83c7-59a54d5d9b26 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:54.517888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 152/308] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:54 2022] GET /identity/v3/users/d2f2c1cf096747f3bac12e6de75cb102 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:54.524738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf96daa-035e-4176-83c7-59a54d5d9b26 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:54.571160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9dd89-da6f-441b-8441-3f131edffdb0 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:54.608887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c00c8-2a6d-46af-a2d9-3d40df67e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:54.609426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c00c8-2a6d-46af-a2d9-3d40df67e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.609705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c00c8-2a6d-46af-a2d9-3d40df67e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.609980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c00c8-2a6d-46af-a2d9-3d40df67e3c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.610769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c00c8-2a6d-46af-a2d9-3d40df67e3c3 None admin] RBAC: Adding query filter params (role.id=bc25d3d5fc6a4fb19a587d70e771145d, user.id=50cfa3d9ac814a609f521dfe41c1acf5, scope.system=all) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:54.611125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c00c8-2a6d-46af-a2d9-3d40df67e3c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:54.612563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c00c8-2a6d-46af-a2d9-3d40df67e3c3 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:54.618261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 157/309] 10.222.0.46 () {56 vars in 1308 bytes} [Tue Jul 26 07:38:54 2022] GET /identity/v3/role_assignments?user.id=50cfa3d9ac814a609f521dfe41c1acf5&scope.system=all&role.id=bc25d3d5fc6a4fb19a587d70e771145d => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:54.648470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf96daa-035e-4176-83c7-59a54d5d9b26 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:54.681963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:54.689026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be15956-4d2e-4ce4-b0aa-3484d02506f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:54.689792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15956-4d2e-4ce4-b0aa-3484d02506f5 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.689997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15956-4d2e-4ce4-b0aa-3484d02506f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.690275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15956-4d2e-4ce4-b0aa-3484d02506f5 None admin] PATH_INFO: `/v3/system/users/d2f2c1cf096747f3bac12e6de75cb102/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.692521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be15956-4d2e-4ce4-b0aa-3484d02506f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d2f2c1cf096747f3bac12e6de75cb102, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:54.694035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be15956-4d2e-4ce4-b0aa-3484d02506f5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:54.706905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 153/310] 10.222.0.46 () {58 vars in 1334 bytes} [Tue Jul 26 07:38:54 2022] PUT /identity/v3/system/users/d2f2c1cf096747f3bac12e6de75cb102/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:54.917186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ad6e-ba54-4ca3-8640-5d672a93d55a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.917514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ad6e-ba54-4ca3-8640-5d672a93d55a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.917742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ad6e-ba54-4ca3-8640-5d672a93d55a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.919396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 158/311] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:54.924763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768686a-9ea2-4e2e-adf8-c4e39e23afb0 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:54.925056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768686a-9ea2-4e2e-adf8-c4e39e23afb0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:54.925338 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768686a-9ea2-4e2e-adf8-c4e39e23afb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:54.944034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e768686a-9ea2-4e2e-adf8-c4e39e23afb0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:54.945236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e768686a-9ea2-4e2e-adf8-c4e39e23afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:55.018313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 154/312] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:55.044262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541ad6e-ba54-4ca3-8640-5d672a93d55a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:55.155288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541ad6e-ba54-4ca3-8640-5d672a93d55a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:55.170584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:55.193747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d4f7-62d5-4311-a804-b25bc4bc9cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:55.194395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d4f7-62d5-4311-a804-b25bc4bc9cde None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:55.194731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d4f7-62d5-4311-a804-b25bc4bc9cde None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:55.195046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d4f7-62d5-4311-a804-b25bc4bc9cde None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:55.205697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6d4f7-62d5-4311-a804-b25bc4bc9cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-37b6d4f7-62d5-4311-a804-b25bc4bc9cde None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:55.210865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:55.211739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:55.212579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 159/313] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:55.217826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768686a-9ea2-4e2e-adf8-c4e39e23afb0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:55.320148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768686a-9ea2-4e2e-adf8-c4e39e23afb0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:55.344828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:55.356799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:55.357871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:55.358685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:55.359196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:55.359951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:55.360257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:55.361637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:55.375194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 155/314] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:55.376175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d4f7-62d5-4311-a804-b25bc4bc9cde None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:55.482604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d4f7-62d5-4311-a804-b25bc4bc9cde None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:55.516763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5c08c-fea8-4e9f-b457-a60cef9150f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:55.517409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c08c-fea8-4e9f-b457-a60cef9150f5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:55.517688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c08c-fea8-4e9f-b457-a60cef9150f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:55.517963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c08c-fea8-4e9f-b457-a60cef9150f5 None admin] PATH_INFO: `/v3/users/ce448e0b8d334f259bc53b394b4a569c` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:55.519158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5c08c-fea8-4e9f-b457-a60cef9150f5 None admin] RBAC: Authorizing `identity:get_user(user_id=ce448e0b8d334f259bc53b394b4a569c)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:55.520864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5c08c-fea8-4e9f-b457-a60cef9150f5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:55.522802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 160/315] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:55 2022] GET /identity/v3/users/ce448e0b8d334f259bc53b394b4a569c => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:55.528681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:55.633788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4328-657a-4d8c-8a3b-2373311056f0 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:55.668934 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a13b0-2085-49fd-9393-ff229ffa4ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:55.669854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a13b0-2085-49fd-9393-ff229ffa4ba0 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:55.670328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a13b0-2085-49fd-9393-ff229ffa4ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:55.670793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a13b0-2085-49fd-9393-ff229ffa4ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:55.726977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:55.741920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a13b0-2085-49fd-9393-ff229ffa4ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:55.743850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a13b0-2085-49fd-9393-ff229ffa4ba0 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:55.849756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 156/316] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:38:55.856142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5c08c-fea8-4e9f-b457-a60cef9150f5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:55.901834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:55.958307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5c08c-fea8-4e9f-b457-a60cef9150f5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:55.992380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ac71f-cb21-4635-b5f5-51f2c9365575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:55.993016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ac71f-cb21-4635-b5f5-51f2c9365575 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:55.993292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ac71f-cb21-4635-b5f5-51f2c9365575 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:55.993564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ac71f-cb21-4635-b5f5-51f2c9365575 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:55.994789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ac71f-cb21-4635-b5f5-51f2c9365575 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:55.996311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ac71f-cb21-4635-b5f5-51f2c9365575 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:55.998016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 161/317] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:38:55 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:56.003849 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a13b0-2085-49fd-9393-ff229ffa4ba0 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:56.091335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:56.107175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a13b0-2085-49fd-9393-ff229ffa4ba0 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:56.142176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f96551-ac5c-4581-a59f-e0f66c6a375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:56.142791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f96551-ac5c-4581-a59f-e0f66c6a375e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.143102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f96551-ac5c-4581-a59f-e0f66c6a375e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.143377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f96551-ac5c-4581-a59f-e0f66c6a375e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.144164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f96551-ac5c-4581-a59f-e0f66c6a375e None admin] RBAC: Adding query filter params (role.id=bc25d3d5fc6a4fb19a587d70e771145d, scope.project.id=273944e75b144a7dac98dfa191ba1fa4, user.id=ce448e0b8d334f259bc53b394b4a569c) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:56.144527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f96551-ac5c-4581-a59f-e0f66c6a375e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:56.146281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f96551-ac5c-4581-a59f-e0f66c6a375e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:56.152520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 157/318] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:38:56 2022] GET /identity/v3/role_assignments?user.id=ce448e0b8d334f259bc53b394b4a569c&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=bc25d3d5fc6a4fb19a587d70e771145d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:56.340324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3f8c-b35f-4438-9578-13b9f883cf58 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.340983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3f8c-b35f-4438-9578-13b9f883cf58 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.341491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3f8c-b35f-4438-9578-13b9f883cf58 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.343087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 162/319] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:56.348499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578e83-0ebd-4866-bdfd-62a76dd9d0ce None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.349027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578e83-0ebd-4866-bdfd-62a76dd9d0ce None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.349518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578e83-0ebd-4866-bdfd-62a76dd9d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.368161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7d578e83-0ebd-4866-bdfd-62a76dd9d0ce None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:56.370209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7d578e83-0ebd-4866-bdfd-62a76dd9d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:56.438300 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 158/320] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:56.460771 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3f8c-b35f-4438-9578-13b9f883cf58 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:56.564986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3f8c-b35f-4438-9578-13b9f883cf58 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:56.576837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:56.600830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53409ce0-e3df-401c-8885-fd747bd7472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:56.601766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409ce0-e3df-401c-8885-fd747bd7472c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.602294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409ce0-e3df-401c-8885-fd747bd7472c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.602765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409ce0-e3df-401c-8885-fd747bd7472c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.604683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53409ce0-e3df-401c-8885-fd747bd7472c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:56.606380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53409ce0-e3df-401c-8885-fd747bd7472c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:56.608263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 163/321] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:38:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:56.616755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d578e83-0ebd-4866-bdfd-62a76dd9d0ce None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:56.688524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda2a1-002b-457a-8df7-a5b6f58451e2 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.688877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda2a1-002b-457a-8df7-a5b6f58451e2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.689078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda2a1-002b-457a-8df7-a5b6f58451e2 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.690426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 164/322] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:38:56.695317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221abb4-c54e-4d19-bb35-c819ae413e35 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.695603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221abb4-c54e-4d19-bb35-c819ae413e35 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.695878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221abb4-c54e-4d19-bb35-c819ae413e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.700003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:56.714318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f221abb4-c54e-4d19-bb35-c819ae413e35 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:56.715555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f221abb4-c54e-4d19-bb35-c819ae413e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:56.721629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d578e83-0ebd-4866-bdfd-62a76dd9d0ce None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:56.757772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf971-c671-47c4-b28f-770006c756c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:56.758424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf971-c671-47c4-b28f-770006c756c4 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.758651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf971-c671-47c4-b28f-770006c756c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.758915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf971-c671-47c4-b28f-770006c756c4 None admin] PATH_INFO: `/v3/groups` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.759646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf971-c671-47c4-b28f-770006c756c4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:56.761077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf971-c671-47c4-b28f-770006c756c4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:56.778618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 159/323] 10.222.0.46 () {60 vars in 1134 bytes} [Tue Jul 26 07:38:56 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:38:56.780237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69cddf-a883-4bd9-a009-c9415d9988e9 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.780530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69cddf-a883-4bd9-a009-c9415d9988e9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.780809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69cddf-a883-4bd9-a009-c9415d9988e9 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.782227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 160/324] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:56.787776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40dd79-f33d-4d7a-b693-93096552a255 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.788066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40dd79-f33d-4d7a-b693-93096552a255 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.788435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40dd79-f33d-4d7a-b693-93096552a255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.793236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 165/325] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:38:56.810128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5c40dd79-f33d-4d7a-b693-93096552a255 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:56.811402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5c40dd79-f33d-4d7a-b693-93096552a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:56.815110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221abb4-c54e-4d19-bb35-c819ae413e35 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:56.893257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 161/326] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:56.917699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40dd79-f33d-4d7a-b693-93096552a255 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:56.925880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221abb4-c54e-4d19-bb35-c819ae413e35 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:56.935926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:56.965776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d68b7b-1660-42a5-90b6-e9981f28c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:56.966434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68b7b-1660-42a5-90b6-e9981f28c6ab None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:56.966717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68b7b-1660-42a5-90b6-e9981f28c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:56.967020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68b7b-1660-42a5-90b6-e9981f28c6ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:56.983831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d68b7b-1660-42a5-90b6-e9981f28c6ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-36d68b7b-1660-42a5-90b6-e9981f28c6ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:56.988876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:56.991444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:56.992246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 166/327] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:38:56.996336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:56.996669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d68b7b-1660-42a5-90b6-e9981f28c6ab None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:57.038959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40dd79-f33d-4d7a-b693-93096552a255 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:57.084713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a490-6900-4503-a029-c52c05284325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:57.085369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a490-6900-4503-a029-c52c05284325 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:57.085649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a490-6900-4503-a029-c52c05284325 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:57.085922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a490-6900-4503-a029-c52c05284325 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:57.100480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076a490-6900-4503-a029-c52c05284325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-1076a490-6900-4503-a029-c52c05284325 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:57.106594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:57.107538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:57.108342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:38:57.110261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 162/328] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:57.117580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a490-6900-4503-a029-c52c05284325 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:57.127563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d68b7b-1660-42a5-90b6-e9981f28c6ab None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:57.175202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:57.176221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:57.176568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:57.177099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:57.178137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:57.178453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:57.179952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:57.190691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 167/329] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:57.195754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:57.238261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:57.254506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a490-6900-4503-a029-c52c05284325 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:57.295567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:57.304094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:57.305443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:57.306242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:57.306720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:57.307945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:57.308937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:57.311106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:57.323700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 163/330] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:57.329166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:57.331800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2024e1-d7e7-40f3-adf1-020b98283b6e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:57.368021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4804bfb-f1bf-44b6-a629-8ae7126b2fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:57.369080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804bfb-f1bf-44b6-a629-8ae7126b2fea None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:57.369585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804bfb-f1bf-44b6-a629-8ae7126b2fea None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:57.370069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4804bfb-f1bf-44b6-a629-8ae7126b2fea None admin] PATH_INFO: `/v3/users/50cfa3d9ac814a609f521dfe41c1acf5` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:57.371525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4804bfb-f1bf-44b6-a629-8ae7126b2fea None admin] RBAC: Authorizing `identity:get_user(user_id=50cfa3d9ac814a609f521dfe41c1acf5)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:57.373339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4804bfb-f1bf-44b6-a629-8ae7126b2fea None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:57.375518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 168/331] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:57 2022] GET /identity/v3/users/50cfa3d9ac814a609f521dfe41c1acf5 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:57.381129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4804bfb-f1bf-44b6-a629-8ae7126b2fea None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:57.461240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd9fc3-18a5-496e-98e6-a8ad1fc5f5e7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:57.494837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:57.498885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4804bfb-f1bf-44b6-a629-8ae7126b2fea None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:57.508503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb25c37-c948-4b72-80cf-49999323828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:57.509513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25c37-c948-4b72-80cf-49999323828d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:57.510012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25c37-c948-4b72-80cf-49999323828d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:57.510821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25c37-c948-4b72-80cf-49999323828d None admin] PATH_INFO: `/v3/users/d2f2c1cf096747f3bac12e6de75cb102` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:57.513071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb25c37-c948-4b72-80cf-49999323828d None admin] RBAC: Authorizing `identity:get_user(user_id=d2f2c1cf096747f3bac12e6de75cb102)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:57.515409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb25c37-c948-4b72-80cf-49999323828d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:57.519115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 164/332] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:38:57 2022] GET /identity/v3/users/d2f2c1cf096747f3bac12e6de75cb102 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:38:57.526279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb25c37-c948-4b72-80cf-49999323828d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:57.545781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e7a4e-9396-4d35-96b2-2fe7ab798f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:57.546276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e7a4e-9396-4d35-96b2-2fe7ab798f56 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:57.546557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e7a4e-9396-4d35-96b2-2fe7ab798f56 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:57.546883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e7a4e-9396-4d35-96b2-2fe7ab798f56 None admin] PATH_INFO: `/v3/system/users/50cfa3d9ac814a609f521dfe41c1acf5/roles/bc25d3d5fc6a4fb19a587d70e771145d` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:57.548422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e7a4e-9396-4d35-96b2-2fe7ab798f56 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=50cfa3d9ac814a609f521dfe41c1acf5, role_id=bc25d3d5fc6a4fb19a587d70e771145d)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:57.549866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e7a4e-9396-4d35-96b2-2fe7ab798f56 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:57.562499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 169/333] 10.222.0.46 () {58 vars in 1334 bytes} [Tue Jul 26 07:38:57 2022] PUT /identity/v3/system/users/50cfa3d9ac814a609f521dfe41c1acf5/roles/bc25d3d5fc6a4fb19a587d70e771145d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:38:57.610054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:57.664452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb25c37-c948-4b72-80cf-49999323828d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:57.704001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc30d1c-7388-48f5-b909-cfd7ee8964e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:57.704680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30d1c-7388-48f5-b909-cfd7ee8964e1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:57.704962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30d1c-7388-48f5-b909-cfd7ee8964e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:57.705286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc30d1c-7388-48f5-b909-cfd7ee8964e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:57.706083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc30d1c-7388-48f5-b909-cfd7ee8964e1 None admin] RBAC: Adding query filter params (role.id=76ec473c1ae74b7880a67166a2fe69ab, user.id=d2f2c1cf096747f3bac12e6de75cb102, scope.system=all) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:57.706393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc30d1c-7388-48f5-b909-cfd7ee8964e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:57.707868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc30d1c-7388-48f5-b909-cfd7ee8964e1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:57.724529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 165/334] 10.222.0.46 () {56 vars in 1308 bytes} [Tue Jul 26 07:38:57 2022] GET /identity/v3/role_assignments?user.id=d2f2c1cf096747f3bac12e6de75cb102&scope.system=all&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:59.184304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8af9-1109-4889-8cc7-74f9983112a3 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:59.184853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8af9-1109-4889-8cc7-74f9983112a3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:59.184853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8af9-1109-4889-8cc7-74f9983112a3 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:59.186507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 170/335] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:59.201222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09e2d-0fa0-467b-8659-d7008092d35c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:59.201712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09e2d-0fa0-467b-8659-d7008092d35c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:59.201789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a09e2d-0fa0-467b-8659-d7008092d35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:59.227945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-11a09e2d-0fa0-467b-8659-d7008092d35c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:59.229153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-11a09e2d-0fa0-467b-8659-d7008092d35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:59.308105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 166/336] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:38:59.342466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8af9-1109-4889-8cc7-74f9983112a3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:59.457579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8af9-1109-4889-8cc7-74f9983112a3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:59.505719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9e223-3397-4135-879b-2af99a2cef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:59.506367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e223-3397-4135-879b-2af99a2cef59 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:59.506650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e223-3397-4135-879b-2af99a2cef59 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:59.506921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e223-3397-4135-879b-2af99a2cef59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:59.521235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9e223-3397-4135-879b-2af99a2cef59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-b7b9e223-3397-4135-879b-2af99a2cef59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:38:59.526729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:38:59.527633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:38:59.528413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 171/337] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:38:59.533684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a09e2d-0fa0-467b-8659-d7008092d35c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:59.597374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:59.615963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2eed0-f794-4182-a068-4c8f7ddf613f None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:59.616274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2eed0-f794-4182-a068-4c8f7ddf613f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:59.616500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2eed0-f794-4182-a068-4c8f7ddf613f None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:59.618083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 172/338] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:38:59.623712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cdc55-3cd4-47f4-8977-5484c948a8bb None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:59.623991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cdc55-3cd4-47f4-8977-5484c948a8bb None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:59.624261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cdc55-3cd4-47f4-8977-5484c948a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:59.660067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5b9cdc55-3cd4-47f4-8977-5484c948a8bb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:38:59.661264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5b9cdc55-3cd4-47f4-8977-5484c948a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:38:59.698673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:38:59.713816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a09e2d-0fa0-467b-8659-d7008092d35c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:38:59.811647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:38:59.812282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:38:59.812556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:38:59.812826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:38:59.813559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:38:59.813860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:38:59.815264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:38:59.820571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 173/339] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 26 07:38:59.826303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 167/340] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:38:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:38:59.831477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cdc55-3cd4-47f4-8977-5484c948a8bb None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:38:59.876963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:00.031739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cdc55-3cd4-47f4-8977-5484c948a8bb None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:00.099618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd574fb5-3ed3-4183-a6e6-8b6474da4465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:00.100258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd574fb5-3ed3-4183-a6e6-8b6474da4465 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.100538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd574fb5-3ed3-4183-a6e6-8b6474da4465 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.100810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd574fb5-3ed3-4183-a6e6-8b6474da4465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.143412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:00.149349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e50eea-1944-4443-bd05-10017e5ab009 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:00.170460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:00.232544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b92939-58a5-4ceb-be62-966da768fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:00.233176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92939-58a5-4ceb-be62-966da768fe2b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.233461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92939-58a5-4ceb-be62-966da768fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.234510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92939-58a5-4ceb-be62-966da768fe2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.242971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd574fb5-3ed3-4183-a6e6-8b6474da4465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:00.245183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd574fb5-3ed3-4183-a6e6-8b6474da4465 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:00.267862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b92939-58a5-4ceb-be62-966da768fe2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-77b92939-58a5-4ceb-be62-966da768fe2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:00.273604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:00.274485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:00.275377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 168/341] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:38:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:00.276497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19aa1f-7634-4dc4-bbf6-58a66c942a2f None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.276655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19aa1f-7634-4dc4-bbf6-58a66c942a2f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.277758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19aa1f-7634-4dc4-bbf6-58a66c942a2f None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.278060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 169/342] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:00.284296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19aa1f-7634-4dc4-bbf6-58a66c942a2f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:00.373647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 174/343] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:00.377308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71546-88e4-4530-9708-31aa6f6efdb5 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.380033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71546-88e4-4530-9708-31aa6f6efdb5 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.381223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71546-88e4-4530-9708-31aa6f6efdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.413068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-adb71546-88e4-4530-9708-31aa6f6efdb5 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:00.416489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-adb71546-88e4-4530-9708-31aa6f6efdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:00.481262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19aa1f-7634-4dc4-bbf6-58a66c942a2f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:00.503482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:00.529515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de750849-24d8-4f39-b373-99c55490d087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:00.530161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750849-24d8-4f39-b373-99c55490d087 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.530443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750849-24d8-4f39-b373-99c55490d087 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.530861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750849-24d8-4f39-b373-99c55490d087 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.532007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de750849-24d8-4f39-b373-99c55490d087 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:00.532322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de750849-24d8-4f39-b373-99c55490d087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:00.534178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de750849-24d8-4f39-b373-99c55490d087 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:00.543695 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 175/344] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:00.544497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71546-88e4-4530-9708-31aa6f6efdb5 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:00.545986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 170/345] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:00.547622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2c1f-b588-44b2-9096-ff8514d438f8 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.547920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2c1f-b588-44b2-9096-ff8514d438f8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.549079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2c1f-b588-44b2-9096-ff8514d438f8 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.550432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 171/346] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:00.554757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad2c1f-b588-44b2-9096-ff8514d438f8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:00.611296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:00.678942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71546-88e4-4530-9708-31aa6f6efdb5 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:00.689703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad2c1f-b588-44b2-9096-ff8514d438f8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:00.724494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f070e7-6d0f-4712-8e6c-31a65c3bc64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:00.725155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f070e7-6d0f-4712-8e6c-31a65c3bc64f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.725439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f070e7-6d0f-4712-8e6c-31a65c3bc64f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.725715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f070e7-6d0f-4712-8e6c-31a65c3bc64f None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.727064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f070e7-6d0f-4712-8e6c-31a65c3bc64f None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:00.729088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f070e7-6d0f-4712-8e6c-31a65c3bc64f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:00.730971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 176/347] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:00 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:00.734215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901af4-01da-4dc1-8646-9ee61bf9b024 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.734601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901af4-01da-4dc1-8646-9ee61bf9b024 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.734887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901af4-01da-4dc1-8646-9ee61bf9b024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.742248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa48ce-e1db-4489-b82a-bcaf5effd48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:00.742889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa48ce-e1db-4489-b82a-bcaf5effd48f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.743196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa48ce-e1db-4489-b82a-bcaf5effd48f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.743453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa48ce-e1db-4489-b82a-bcaf5effd48f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:00.753888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-6e901af4-01da-4dc1-8646-9ee61bf9b024 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:00.755135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6e901af4-01da-4dc1-8646-9ee61bf9b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:00.815450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:00.818507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa48ce-e1db-4489-b82a-bcaf5effd48f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:00.820000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa48ce-e1db-4489-b82a-bcaf5effd48f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:00.829444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 177/348] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:00.830478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e901af4-01da-4dc1-8646-9ee61bf9b024 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:00.853830 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:00.930769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 172/349] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:00.932262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa48ce-e1db-4489-b82a-bcaf5effd48f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:00.949133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e901af4-01da-4dc1-8646-9ee61bf9b024 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:00.988336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08198a97-996a-4033-a68e-2043d64e23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:00.988989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198a97-996a-4033-a68e-2043d64e23ba None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:00.989273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198a97-996a-4033-a68e-2043d64e23ba None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:00.989545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198a97-996a-4033-a68e-2043d64e23ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.001815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08198a97-996a-4033-a68e-2043d64e23ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-08198a97-996a-4033-a68e-2043d64e23ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:01.008001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:01.008902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:01.009761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 178/350] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:01.014884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08198a97-996a-4033-a68e-2043d64e23ba None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.037445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa48ce-e1db-4489-b82a-bcaf5effd48f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.068267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:01.071404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:01.073608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3cadf-a75d-4568-9daa-a5f63535567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.074385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3cadf-a75d-4568-9daa-a5f63535567c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.074833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3cadf-a75d-4568-9daa-a5f63535567c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.075155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3cadf-a75d-4568-9daa-a5f63535567c None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.082137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3cadf-a75d-4568-9daa-a5f63535567c None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:01.083888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3cadf-a75d-4568-9daa-a5f63535567c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:01.085771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 173/351] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:00 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:01.086782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3cadf-a75d-4568-9daa-a5f63535567c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.149931 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08198a97-996a-4033-a68e-2043d64e23ba None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.198560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19201f-974f-4516-a690-8ef2b3e48343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.199855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19201f-974f-4516-a690-8ef2b3e48343 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.199855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19201f-974f-4516-a690-8ef2b3e48343 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.199855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19201f-974f-4516-a690-8ef2b3e48343 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.214524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19201f-974f-4516-a690-8ef2b3e48343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:01.220113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3cadf-a75d-4568-9daa-a5f63535567c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-6e19201f-974f-4516-a690-8ef2b3e48343 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:01.220528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:01.221382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:01.222208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 179/352] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:01.222845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19201f-974f-4516-a690-8ef2b3e48343 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.265807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e20079-d136-4ef6-9224-cb81e8287b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.267131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e20079-d136-4ef6-9224-cb81e8287b01 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.267131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e20079-d136-4ef6-9224-cb81e8287b01 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.267131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e20079-d136-4ef6-9224-cb81e8287b01 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.269955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e20079-d136-4ef6-9224-cb81e8287b01 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:01.271450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e20079-d136-4ef6-9224-cb81e8287b01 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:01.273355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 174/353] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:01.275122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e20079-d136-4ef6-9224-cb81e8287b01 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.348356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:01.352561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:01.353518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19201f-974f-4516-a690-8ef2b3e48343 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.402183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04303481-3b22-4dc3-9cb1-b12934d86e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.403085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303481-3b22-4dc3-9cb1-b12934d86e53 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.403533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303481-3b22-4dc3-9cb1-b12934d86e53 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.403908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e20079-d136-4ef6-9224-cb81e8287b01 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.404097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303481-3b22-4dc3-9cb1-b12934d86e53 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.404950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04303481-3b22-4dc3-9cb1-b12934d86e53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:01.405393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04303481-3b22-4dc3-9cb1-b12934d86e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:01.406964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04303481-3b22-4dc3-9cb1-b12934d86e53 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:01.420790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 180/354] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:01.422222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6a90-1c8a-4875-8672-dde1b14abeb1 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.422508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6a90-1c8a-4875-8672-dde1b14abeb1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.422784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6a90-1c8a-4875-8672-dde1b14abeb1 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.424276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 181/355] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:01.429281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc6a90-1c8a-4875-8672-dde1b14abeb1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.446640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.447367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.447648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.447920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.448720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] RBAC: Adding query filter params (group.id=c72d4dea070a46f69f914cf77fb0162e, role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:01.449035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:01.450476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:01.457594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 175/356] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/role_assignments?group.id=c72d4dea070a46f69f914cf77fb0162e&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:01.458220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.558542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc6a90-1c8a-4875-8672-dde1b14abeb1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.576818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80560-ca11-4765-8753-c81eee6ab884 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.604348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.604901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.605189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.605464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.606193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:01.606505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:01.607939 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:01.612591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:01.617775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 182/357] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:01.618637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.625508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ef662-0ea2-45fc-8e68-7f58bee1e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.626179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef662-0ea2-45fc-8e68-7f58bee1e860 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.626461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef662-0ea2-45fc-8e68-7f58bee1e860 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.626737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef662-0ea2-45fc-8e68-7f58bee1e860 None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.628024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ef662-0ea2-45fc-8e68-7f58bee1e860 None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:01.629509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ef662-0ea2-45fc-8e68-7f58bee1e860 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:01.631345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 176/358] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:01.632323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb570c-d6f3-4b35-b9fe-19d09247c554 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.632625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb570c-d6f3-4b35-b9fe-19d09247c554 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.632884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb570c-d6f3-4b35-b9fe-19d09247c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.652746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:01.653109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3cdb570c-d6f3-4b35-b9fe-19d09247c554 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:01.654628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3cdb570c-d6f3-4b35-b9fe-19d09247c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:01.748011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 177/359] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:01.749059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d3b80-1f3f-45d0-b7d9-378e15747232 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.749343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d3b80-1f3f-45d0-b7d9-378e15747232 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.749615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d3b80-1f3f-45d0-b7d9-378e15747232 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.751004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 178/360] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:01.758963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d3b80-1f3f-45d0-b7d9-378e15747232 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.778806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d26ca-8669-473a-a343-2b4394357229 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.824562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8963-efd4-4a08-b759-3e73b9f48dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.825220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8963-efd4-4a08-b759-3e73b9f48dd2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.825496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8963-efd4-4a08-b759-3e73b9f48dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.825767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8963-efd4-4a08-b759-3e73b9f48dd2 None admin] PATH_INFO: `/v3/users/50cfa3d9ac814a609f521dfe41c1acf5` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.827621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a8963-efd4-4a08-b759-3e73b9f48dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=50cfa3d9ac814a609f521dfe41c1acf5)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:01.828432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a8963-efd4-4a08-b759-3e73b9f48dd2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:01.830336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 183/361] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/users/50cfa3d9ac814a609f521dfe41c1acf5 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:01.832185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8963-efd4-4a08-b759-3e73b9f48dd2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:01.888998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d3b80-1f3f-45d0-b7d9-378e15747232 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:01.920930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:01.937497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8f479-e393-47a7-9b49-f50a515b32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:01.938138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f479-e393-47a7-9b49-f50a515b32d6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:01.938421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f479-e393-47a7-9b49-f50a515b32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:01.938699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f479-e393-47a7-9b49-f50a515b32d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:01.951580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:01.962066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8963-efd4-4a08-b759-3e73b9f48dd2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:02.011491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e19956-dfa5-45c4-bc47-e436bfdee65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:02.012117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e19956-dfa5-45c4-bc47-e436bfdee65a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.012399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e19956-dfa5-45c4-bc47-e436bfdee65a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.012692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e19956-dfa5-45c4-bc47-e436bfdee65a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.013463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e19956-dfa5-45c4-bc47-e436bfdee65a None admin] RBAC: Adding query filter params (group.id=c72d4dea070a46f69f914cf77fb0162e, role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:02.013774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e19956-dfa5-45c4-bc47-e436bfdee65a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:02.016048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e19956-dfa5-45c4-bc47-e436bfdee65a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:02.023013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 184/362] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/role_assignments?group.id=c72d4dea070a46f69f914cf77fb0162e&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:02.024216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45992e3b-5efb-419f-9d6d-077334aada57 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.024498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45992e3b-5efb-419f-9d6d-077334aada57 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.024833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45992e3b-5efb-419f-9d6d-077334aada57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.033813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8f479-e393-47a7-9b49-f50a515b32d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:02.035662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8f479-e393-47a7-9b49-f50a515b32d6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:02.054985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-45992e3b-5efb-419f-9d6d-077334aada57 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:02.057822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-45992e3b-5efb-419f-9d6d-077334aada57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:02.160732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 185/363] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:02.162457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45992e3b-5efb-419f-9d6d-077334aada57 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.179068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 179/364] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:02.180146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8f479-e393-47a7-9b49-f50a515b32d6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.214557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:02.310752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8f479-e393-47a7-9b49-f50a515b32d6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:02.313573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:02.334587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45992e3b-5efb-419f-9d6d-077334aada57 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:02.357742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc80911-017e-4c80-b000-284144993906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:02.358366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc80911-017e-4c80-b000-284144993906 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.358652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc80911-017e-4c80-b000-284144993906 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.358946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc80911-017e-4c80-b000-284144993906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.359812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc80911-017e-4c80-b000-284144993906 None admin] RBAC: Adding query filter params (role.id=bc25d3d5fc6a4fb19a587d70e771145d, user.id=50cfa3d9ac814a609f521dfe41c1acf5, scope.system=all) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:02.360127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc80911-017e-4c80-b000-284144993906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:02.362734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc80911-017e-4c80-b000-284144993906 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:02.374544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76668d89-0816-4dff-92b4-eedde2b50bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:02.375239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76668d89-0816-4dff-92b4-eedde2b50bbf None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.375524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76668d89-0816-4dff-92b4-eedde2b50bbf None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.375795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76668d89-0816-4dff-92b4-eedde2b50bbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.377356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 180/365] 10.222.0.46 () {56 vars in 1308 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/role_assignments?user.id=50cfa3d9ac814a609f521dfe41c1acf5&scope.system=all&role.id=bc25d3d5fc6a4fb19a587d70e771145d => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:02.378203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc80911-017e-4c80-b000-284144993906 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.397434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76668d89-0816-4dff-92b4-eedde2b50bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-76668d89-0816-4dff-92b4-eedde2b50bbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:02.408627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:02.410778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:02.412753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 186/366] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:02.416662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76668d89-0816-4dff-92b4-eedde2b50bbf None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.485643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:02.513666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc80911-017e-4c80-b000-284144993906 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:02.548423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76668d89-0816-4dff-92b4-eedde2b50bbf None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:02.563499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27857e93-7247-40ae-95d9-f48368d95d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:02.564165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27857e93-7247-40ae-95d9-f48368d95d72 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.564451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27857e93-7247-40ae-95d9-f48368d95d72 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.564728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27857e93-7247-40ae-95d9-f48368d95d72 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.565924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27857e93-7247-40ae-95d9-f48368d95d72 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:02.567408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27857e93-7247-40ae-95d9-f48368d95d72 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:02.569277 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 181/367] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:02.569869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27857e93-7247-40ae-95d9-f48368d95d72 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.593090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8619b5-70b5-43f8-b7dc-4bc864634a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:02.593759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8619b5-70b5-43f8-b7dc-4bc864634a32 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.594038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8619b5-70b5-43f8-b7dc-4bc864634a32 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.594307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8619b5-70b5-43f8-b7dc-4bc864634a32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.621798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8619b5-70b5-43f8-b7dc-4bc864634a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7b8619b5-70b5-43f8-b7dc-4bc864634a32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:02.635998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:02.638180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 187/368] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:02.640196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8619b5-70b5-43f8-b7dc-4bc864634a32 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.685722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:02.698086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27857e93-7247-40ae-95d9-f48368d95d72 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:02.739655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:02.740292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.740573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.740851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.741577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:02.741885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:02.743322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:02.755405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 182/369] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:02.756256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.781254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:02.804783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8619b5-70b5-43f8-b7dc-4bc864634a32 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:02.852081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51966-7446-42ba-a284-2aac2a5f4b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:02.853347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51966-7446-42ba-a284-2aac2a5f4b92 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.853347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51966-7446-42ba-a284-2aac2a5f4b92 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.853347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51966-7446-42ba-a284-2aac2a5f4b92 None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.854540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51966-7446-42ba-a284-2aac2a5f4b92 None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:02.856077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51966-7446-42ba-a284-2aac2a5f4b92 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:02.857828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 188/370] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:02.858596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51966-7446-42ba-a284-2aac2a5f4b92 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.887343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407f4b5-3254-45cb-985b-c721356f8083 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:02.923653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:02.924516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:02.924942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:02.925389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:02.926255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:02.926703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:02.928244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:02.937703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 183/371] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:02.938751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:02.943722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:02.972390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51966-7446-42ba-a284-2aac2a5f4b92 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:03.010023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f277ea-d031-4bbf-8aee-30d17a08485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:03.010657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f277ea-d031-4bbf-8aee-30d17a08485d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.011379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f277ea-d031-4bbf-8aee-30d17a08485d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.011379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f277ea-d031-4bbf-8aee-30d17a08485d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.022760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:03.049071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bef8b-3478-473b-a511-21fb7f85f41b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:03.083903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f277ea-d031-4bbf-8aee-30d17a08485d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:03.085258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:03.085421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f277ea-d031-4bbf-8aee-30d17a08485d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:03.086175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.086653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.087305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.089607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] RBAC: Adding query filter params (group.id=c72d4dea070a46f69f914cf77fb0162e, role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=273944e75b144a7dac98dfa191ba1fa4) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:03.090160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:03.091766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:03.099418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 184/372] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/role_assignments?group.id=c72d4dea070a46f69f914cf77fb0162e&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:03.100664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:03.205778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:03.267851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 189/373] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:03.274062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f277ea-d031-4bbf-8aee-30d17a08485d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:03.277822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c70c9-27b5-4d2b-b243-66cd2bc1c5ab None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:03.331686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0d8d-2feb-49f5-bb37-16c2591f42a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:03.332310 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0d8d-2feb-49f5-bb37-16c2591f42a8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.332417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0d8d-2feb-49f5-bb37-16c2591f42a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.332654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0d8d-2feb-49f5-bb37-16c2591f42a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.347305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:03.402880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f277ea-d031-4bbf-8aee-30d17a08485d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:03.414911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c0d8d-2feb-49f5-bb37-16c2591f42a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:03.416934 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c0d8d-2feb-49f5-bb37-16c2591f42a8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:03.441455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed2b47-ee34-41ae-a130-df4d044128d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:03.442493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed2b47-ee34-41ae-a130-df4d044128d6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.443031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed2b47-ee34-41ae-a130-df4d044128d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.443507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed2b47-ee34-41ae-a130-df4d044128d6 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.444941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed2b47-ee34-41ae-a130-df4d044128d6 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:03.446651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed2b47-ee34-41ae-a130-df4d044128d6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:03.448955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 190/374] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:03 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:03.455941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed2b47-ee34-41ae-a130-df4d044128d6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:03.522956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:03.532930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 185/375] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:03.538681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0d8d-2feb-49f5-bb37-16c2591f42a8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:03.607306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:03.627592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed2b47-ee34-41ae-a130-df4d044128d6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:03.697885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deedd8d-7f73-417b-a73c-3e988e68b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:03.698807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deedd8d-7f73-417b-a73c-3e988e68b083 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.699262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deedd8d-7f73-417b-a73c-3e988e68b083 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.699678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deedd8d-7f73-417b-a73c-3e988e68b083 None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.701012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deedd8d-7f73-417b-a73c-3e988e68b083 None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:03.702613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deedd8d-7f73-417b-a73c-3e988e68b083 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:03.705621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 191/376] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:03 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:03.710318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deedd8d-7f73-417b-a73c-3e988e68b083 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:03.727403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0d8d-2feb-49f5-bb37-16c2591f42a8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:03.795975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233459a-5b34-4c41-8725-cbbba6e380b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:03.797068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233459a-5b34-4c41-8725-cbbba6e380b8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.798153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233459a-5b34-4c41-8725-cbbba6e380b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.798758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233459a-5b34-4c41-8725-cbbba6e380b8 None admin] PATH_INFO: `/v3/projects/4e4e301f72114302a7a6060f88f11bb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.801460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233459a-5b34-4c41-8725-cbbba6e380b8 None admin] RBAC: Authorizing `identity:get_project(project_id=4e4e301f72114302a7a6060f88f11bb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:03.803230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233459a-5b34-4c41-8725-cbbba6e380b8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:03.805549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 186/377] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:03 2022] GET /identity/v3/projects/4e4e301f72114302a7a6060f88f11bb3 => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:03.811822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233459a-5b34-4c41-8725-cbbba6e380b8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:03.879466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deedd8d-7f73-417b-a73c-3e988e68b083 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:03.893677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:03.930779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99ec68-052c-4881-9835-9d619990cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:03.932100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ec68-052c-4881-9835-9d619990cd5a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.932481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ec68-052c-4881-9835-9d619990cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.932854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99ec68-052c-4881-9835-9d619990cd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.933771 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99ec68-052c-4881-9835-9d619990cd5a None admin] RBAC: Adding query filter params (group.id=c72d4dea070a46f69f914cf77fb0162e, role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=273944e75b144a7dac98dfa191ba1fa4) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:03.934187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99ec68-052c-4881-9835-9d619990cd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:03.935921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99ec68-052c-4881-9835-9d619990cd5a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:03.943131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 192/378] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:03 2022] GET /identity/v3/role_assignments?group.id=c72d4dea070a46f69f914cf77fb0162e&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:03.944617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9797-9603-4d77-ae6d-fade9793b2bb None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.945013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9797-9603-4d77-ae6d-fade9793b2bb None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.945727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9797-9603-4d77-ae6d-fade9793b2bb None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.947833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 193/379] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:03.953644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1030c-45eb-4a21-b601-c003415772d3 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:03.954070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1030c-45eb-4a21-b601-c003415772d3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:03.954469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1030c-45eb-4a21-b601-c003415772d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:03.960581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233459a-5b34-4c41-8725-cbbba6e380b8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:03.973534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:03.982514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-d6d1030c-45eb-4a21-b601-c003415772d3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:03.983028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d6d1030c-45eb-4a21-b601-c003415772d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:04.020937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eeca1-0660-4873-be51-94d61d6b87bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:04.021842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eeca1-0660-4873-be51-94d61d6b87bc None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.022268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eeca1-0660-4873-be51-94d61d6b87bc None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.022822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eeca1-0660-4873-be51-94d61d6b87bc None admin] PATH_INFO: `/v3/groups/fb4a7f2fe6204ff7aec9580cf870428b` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:04.030123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1eeca1-0660-4873-be51-94d61d6b87bc None admin] RBAC: Authorizing `identity:get_group(group_id=fb4a7f2fe6204ff7aec9580cf870428b)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:04.032522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1eeca1-0660-4873-be51-94d61d6b87bc None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:04.035586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 187/380] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:03 2022] GET /identity/v3/groups/fb4a7f2fe6204ff7aec9580cf870428b => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:04.044231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eeca1-0660-4873-be51-94d61d6b87bc None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:04.089836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 194/381] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:04.127528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1030c-45eb-4a21-b601-c003415772d3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:04.167264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eeca1-0660-4873-be51-94d61d6b87bc None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:04.208657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:04.209545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.209967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.210405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:04.211431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] RBAC: Adding query filter params (group.id=fb4a7f2fe6204ff7aec9580cf870428b, role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=4e4e301f72114302a7a6060f88f11bb3) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:04.211963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:04.213643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:04.222352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 188/382] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:04 2022] GET /identity/v3/role_assignments?group.id=fb4a7f2fe6204ff7aec9580cf870428b&scope.project.id=4e4e301f72114302a7a6060f88f11bb3&role.id=53894f3146884908ba6dd3e118397fb3 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:04.289689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1030c-45eb-4a21-b601-c003415772d3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:04.297209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:04.336801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe677f3-f607-4398-a86a-f4047a2f65b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:04.337997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe677f3-f607-4398-a86a-f4047a2f65b3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.338277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe677f3-f607-4398-a86a-f4047a2f65b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.338547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe677f3-f607-4398-a86a-f4047a2f65b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:04.354355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe677f3-f607-4398-a86a-f4047a2f65b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-dfe677f3-f607-4398-a86a-f4047a2f65b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:04.359643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:04.360587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:04.361391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 195/383] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:04.366781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:04.418668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:04.470225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8232f8e-473e-4d7e-b9d4-4ce125a297b9 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.470711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8232f8e-473e-4d7e-b9d4-4ce125a297b9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.470711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8232f8e-473e-4d7e-b9d4-4ce125a297b9 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:04.472322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 196/384] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:04.477451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807175bf-520b-4bc5-8770-5f9c1d65c7f4 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.477735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807175bf-520b-4bc5-8770-5f9c1d65c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.478656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807175bf-520b-4bc5-8770-5f9c1d65c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:04.495974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e46c9-76f4-4ad2-b4c9-b0860ab15f10 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:04.511954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-807175bf-520b-4bc5-8770-5f9c1d65c7f4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:04.513156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-807175bf-520b-4bc5-8770-5f9c1d65c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:04.533232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:04.534293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.534950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.535428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:04.536375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:04.536891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:04.538998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:04.552219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 189/385] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:39:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:04.557695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:04.684891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464ddb-9a6f-42dd-8319-ba1ace23db2f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:04.708298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:04.710466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 197/386] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:04.724180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fb3b5-0ee6-4eab-bbe9-79bc3a19cefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:04.724929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb3b5-0ee6-4eab-bbe9-79bc3a19cefa None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.725287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb3b5-0ee6-4eab-bbe9-79bc3a19cefa None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.725636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb3b5-0ee6-4eab-bbe9-79bc3a19cefa None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:04.726880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fb3b5-0ee6-4eab-bbe9-79bc3a19cefa None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:04.728980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fb3b5-0ee6-4eab-bbe9-79bc3a19cefa None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:04.730883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 190/387] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:04 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:04.736227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807175bf-520b-4bc5-8770-5f9c1d65c7f4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:04.741676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fb3b5-0ee6-4eab-bbe9-79bc3a19cefa None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:04.874044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fb3b5-0ee6-4eab-bbe9-79bc3a19cefa None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:04.915146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430ce0-4bfe-49f6-8847-db18d640f964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:04.916709 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430ce0-4bfe-49f6-8847-db18d640f964 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.917136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430ce0-4bfe-49f6-8847-db18d640f964 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.917572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430ce0-4bfe-49f6-8847-db18d640f964 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:04.938365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e430ce0-4bfe-49f6-8847-db18d640f964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-3e430ce0-4bfe-49f6-8847-db18d640f964 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:04.944538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:04.945605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:04.946618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:04.953682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:04.954084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 191/388] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:04.955524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430ce0-4bfe-49f6-8847-db18d640f964 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:04.957520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807175bf-520b-4bc5-8770-5f9c1d65c7f4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:04.997239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc6553-de24-482b-9fce-d62b38d8c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:04.997804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc6553-de24-482b-9fce-d62b38d8c18b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:04.998084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc6553-de24-482b-9fce-d62b38d8c18b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:04.998355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc6553-de24-482b-9fce-d62b38d8c18b None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:05.000235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc6553-de24-482b-9fce-d62b38d8c18b None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:05.001697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc6553-de24-482b-9fce-d62b38d8c18b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:05.003712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 198/389] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:04 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:05.009919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:05.010596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc6553-de24-482b-9fce-d62b38d8c18b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:05.120388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430ce0-4bfe-49f6-8847-db18d640f964 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:05.177293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc6553-de24-482b-9fce-d62b38d8c18b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:05.178161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:05.179089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:05.179541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:05.179955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:05.180823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:05.181750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:05.183310 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:05.196293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 192/390] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:05.202065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:05.218569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bffa97-bdea-4f95-a31f-a7f25c243145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:05.219335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bffa97-bdea-4f95-a31f-a7f25c243145 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:05.219618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bffa97-bdea-4f95-a31f-a7f25c243145 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:05.219942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bffa97-bdea-4f95-a31f-a7f25c243145 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/groups/c72d4dea070a46f69f914cf77fb0162e/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:05.221982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bffa97-bdea-4f95-a31f-a7f25c243145 None admin] RBAC: Authorizing `identity:create_grant(project_id=270803d5e32745d7be36c6fe3ecd55aa, group_id=c72d4dea070a46f69f914cf77fb0162e, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:05.225497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bffa97-bdea-4f95-a31f-a7f25c243145 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:05.240548 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 199/391] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jul 26 07:39:05 2022] PUT /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/groups/c72d4dea070a46f69f914cf77fb0162e/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:39:05.330683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:05.345335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f89f3d-9204-48c6-8665-5765c87c0db6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:05.390449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba015-f179-409d-9c6b-c209d693879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:05.391246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba015-f179-409d-9c6b-c209d693879e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:05.391447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba015-f179-409d-9c6b-c209d693879e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:05.391725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba015-f179-409d-9c6b-c209d693879e None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:05.392895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ba015-f179-409d-9c6b-c209d693879e None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:05.394329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ba015-f179-409d-9c6b-c209d693879e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:05.396506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 193/392] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:05 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:05.402165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bffa97-bdea-4f95-a31f-a7f25c243145 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:05.430109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:05.531586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bffa97-bdea-4f95-a31f-a7f25c243145 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:05.568885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a2182-299f-4722-b002-fa2312859fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:05.569925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2182-299f-4722-b002-fa2312859fb6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:05.570415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2182-299f-4722-b002-fa2312859fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:05.570896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2182-299f-4722-b002-fa2312859fb6 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:05.572392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2182-299f-4722-b002-fa2312859fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:05.574050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2182-299f-4722-b002-fa2312859fb6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:05.576265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 200/393] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:05 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:05.582198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba015-f179-409d-9c6b-c209d693879e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:05.689313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba015-f179-409d-9c6b-c209d693879e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:05.731639 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602189-a1c2-471c-88a0-c58c6f8407a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:05.732758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602189-a1c2-471c-88a0-c58c6f8407a8 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:05.733276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602189-a1c2-471c-88a0-c58c6f8407a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:05.733756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602189-a1c2-471c-88a0-c58c6f8407a8 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/groups/c72d4dea070a46f69f914cf77fb0162e/roles/b1f864ecbe4c43b4a5a708fa216488d4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:05.736292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602189-a1c2-471c-88a0-c58c6f8407a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=270803d5e32745d7be36c6fe3ecd55aa, group_id=c72d4dea070a46f69f914cf77fb0162e, role_id=b1f864ecbe4c43b4a5a708fa216488d4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:05.737970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602189-a1c2-471c-88a0-c58c6f8407a8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:05.765346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 194/394] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jul 26 07:39:05 2022] PUT /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa/groups/c72d4dea070a46f69f914cf77fb0162e/roles/b1f864ecbe4c43b4a5a708fa216488d4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:06.244153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551d85-eda0-46d4-9cf3-ca2430a31b82 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:06.244456 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551d85-eda0-46d4-9cf3-ca2430a31b82 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:06.244701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551d85-eda0-46d4-9cf3-ca2430a31b82 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:06.246544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 201/395] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:06.251878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09f5a-6a75-4c9a-9734-3b79242d5a8d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:06.252422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09f5a-6a75-4c9a-9734-3b79242d5a8d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:06.252909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09f5a-6a75-4c9a-9734-3b79242d5a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:06.272030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7dc09f5a-6a75-4c9a-9734-3b79242d5a8d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:06.273535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7dc09f5a-6a75-4c9a-9734-3b79242d5a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:06.285564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:06.352490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 195/396] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:06.374258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0551d85-eda0-46d4-9cf3-ca2430a31b82 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:06.487701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:06.498399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0551d85-eda0-46d4-9cf3-ca2430a31b82 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:06.533261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce411a-202c-463d-ad3c-e6af86460dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:06.534017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce411a-202c-463d-ad3c-e6af86460dc1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:06.534225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce411a-202c-463d-ad3c-e6af86460dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:06.534497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce411a-202c-463d-ad3c-e6af86460dc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:06.545072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce411a-202c-463d-ad3c-e6af86460dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4cce411a-202c-463d-ad3c-e6af86460dc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:06.550642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:06.551628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:06.552549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 202/397] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:06.558438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09f5a-6a75-4c9a-9734-3b79242d5a8d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:06.569903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd2345-6ca2-4716-af7c-cb3c35602351 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:06.570201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd2345-6ca2-4716-af7c-cb3c35602351 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:06.570459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd2345-6ca2-4716-af7c-cb3c35602351 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:06.572694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 203/398] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:39:06.577637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db6f3-42ca-42be-a5fd-7dc0b458378b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:06.577927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db6f3-42ca-42be-a5fd-7dc0b458378b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:06.578212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571db6f3-42ca-42be-a5fd-7dc0b458378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:06.598395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-571db6f3-42ca-42be-a5fd-7dc0b458378b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:06.599974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-571db6f3-42ca-42be-a5fd-7dc0b458378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:06.681978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 204/399] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:06.706270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571db6f3-42ca-42be-a5fd-7dc0b458378b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:06.745768 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09f5a-6a75-4c9a-9734-3b79242d5a8d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:06.804838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:06.806724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:06.807399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:06.807856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:06.808138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:06.808942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] RBAC: Adding query filter params (name=member) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:06.809251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:06.810666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:06.829059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571db6f3-42ca-42be-a5fd-7dc0b458378b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:06.833010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 196/400] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:06.848974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:06.861548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:06.916571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0b667-2112-4d76-bc3b-9291f05cdf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:06.919028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0b667-2112-4d76-bc3b-9291f05cdf4a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:06.919744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0b667-2112-4d76-bc3b-9291f05cdf4a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:06.921261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0b667-2112-4d76-bc3b-9291f05cdf4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:06.941882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0b667-2112-4d76-bc3b-9291f05cdf4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-30c0b667-2112-4d76-bc3b-9291f05cdf4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:06.949991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:06.950901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:06.951724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:06.959760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 205/401] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:06.966875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0b667-2112-4d76-bc3b-9291f05cdf4a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.018623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d67aff-56df-4275-815e-4b74f4fc4098 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.077001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0b667-2112-4d76-bc3b-9291f05cdf4a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.104566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a2436-d7f4-4e9f-9c39-899b5e449809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.105373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2436-d7f4-4e9f-9c39-899b5e449809 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.105653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2436-d7f4-4e9f-9c39-899b5e449809 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.105928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2436-d7f4-4e9f-9c39-899b5e449809 None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.107539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a2436-d7f4-4e9f-9c39-899b5e449809 None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.109232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a2436-d7f4-4e9f-9c39-899b5e449809 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.111714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 197/402] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:06 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:07.112828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20f320-7119-4ec2-8bfa-3b06ee314fa0 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.113108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20f320-7119-4ec2-8bfa-3b06ee314fa0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.113380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20f320-7119-4ec2-8bfa-3b06ee314fa0 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.114701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 198/403] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:07.115924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.116799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.117282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.117756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.119303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:07.119832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.120493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a9c8-27e1-4a9d-915f-bfb8b54044eb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.120780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a9c8-27e1-4a9d-915f-bfb8b54044eb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.121056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a9c8-27e1-4a9d-915f-bfb8b54044eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.122031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.131321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 206/404] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:07.132583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.135619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:07.142001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c793a9c8-27e1-4a9d-915f-bfb8b54044eb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:07.143227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c793a9c8-27e1-4a9d-915f-bfb8b54044eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:07.222610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 199/405] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:07.223665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793a9c8-27e1-4a9d-915f-bfb8b54044eb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.234352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:07.255756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9489c-280b-4a64-a0d8-f3a72dc2c464 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.301249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439f4b2-d9cc-4070-87e4-e422dd982605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.302219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439f4b2-d9cc-4070-87e4-e422dd982605 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.302504 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439f4b2-d9cc-4070-87e4-e422dd982605 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.302787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439f4b2-d9cc-4070-87e4-e422dd982605 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.304157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439f4b2-d9cc-4070-87e4-e422dd982605 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.306594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439f4b2-d9cc-4070-87e4-e422dd982605 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.309866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 207/406] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:07 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:07.312157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439f4b2-d9cc-4070-87e4-e422dd982605 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.347883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793a9c8-27e1-4a9d-915f-bfb8b54044eb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.385160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:07.386808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8883c-956d-4904-9294-2eeddf6a8db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.388008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8883c-956d-4904-9294-2eeddf6a8db4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.388008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8883c-956d-4904-9294-2eeddf6a8db4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.391269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8883c-956d-4904-9294-2eeddf6a8db4 None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.391269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8883c-956d-4904-9294-2eeddf6a8db4 None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.391269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8883c-956d-4904-9294-2eeddf6a8db4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.393422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 200/407] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:07 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:07.395176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8883c-956d-4904-9294-2eeddf6a8db4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.420759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439f4b2-d9cc-4070-87e4-e422dd982605 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.454999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ed4fc-0ae8-47ec-93fb-4895ad4011e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.455876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ed4fc-0ae8-47ec-93fb-4895ad4011e4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.456368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ed4fc-0ae8-47ec-93fb-4895ad4011e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.456818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ed4fc-0ae8-47ec-93fb-4895ad4011e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.467890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ed4fc-0ae8-47ec-93fb-4895ad4011e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-336ed4fc-0ae8-47ec-93fb-4895ad4011e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:07.473463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:07.474344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:07.475139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:07.477766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 208/408] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:07.479262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ed4fc-0ae8-47ec-93fb-4895ad4011e4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.479547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:07.508816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8883c-956d-4904-9294-2eeddf6a8db4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.548705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c71c6-bf0a-4538-8363-41e7616421e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.549519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c71c6-bf0a-4538-8363-41e7616421e4 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.549868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c71c6-bf0a-4538-8363-41e7616421e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.550473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c71c6-bf0a-4538-8363-41e7616421e4 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4/groups/c72d4dea070a46f69f914cf77fb0162e/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.552940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c71c6-bf0a-4538-8363-41e7616421e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=273944e75b144a7dac98dfa191ba1fa4, group_id=c72d4dea070a46f69f914cf77fb0162e, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.554517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c71c6-bf0a-4538-8363-41e7616421e4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.572148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 201/409] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jul 26 07:39:07 2022] PUT /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4/groups/c72d4dea070a46f69f914cf77fb0162e/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:07.573093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c71c6-bf0a-4538-8363-41e7616421e4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.591398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ed4fc-0ae8-47ec-93fb-4895ad4011e4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.629998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:07.637980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72ba5e-6037-4497-8a06-cd00ec1d3848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.638921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72ba5e-6037-4497-8a06-cd00ec1d3848 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.639842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72ba5e-6037-4497-8a06-cd00ec1d3848 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.640306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72ba5e-6037-4497-8a06-cd00ec1d3848 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.642234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72ba5e-6037-4497-8a06-cd00ec1d3848 None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.644408 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72ba5e-6037-4497-8a06-cd00ec1d3848 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.647852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 209/410] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:07 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:07.655980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72ba5e-6037-4497-8a06-cd00ec1d3848 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.716861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c71c6-bf0a-4538-8363-41e7616421e4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.759489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.760180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.760733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.761013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.761819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:07.762127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.763654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.766458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:07.781108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 202/411] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:07.790241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.846373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72ba5e-6037-4497-8a06-cd00ec1d3848 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.895700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9ea90-83f1-4a8b-9b95-49639bafb120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.896772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ea90-83f1-4a8b-9b95-49639bafb120 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.897057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ea90-83f1-4a8b-9b95-49639bafb120 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.897337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ea90-83f1-4a8b-9b95-49639bafb120 None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4/groups/c72d4dea070a46f69f914cf77fb0162e/roles/b1f864ecbe4c43b4a5a708fa216488d4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.901302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9ea90-83f1-4a8b-9b95-49639bafb120 None admin] RBAC: Authorizing `identity:create_grant(project_id=273944e75b144a7dac98dfa191ba1fa4, group_id=c72d4dea070a46f69f914cf77fb0162e, role_id=b1f864ecbe4c43b4a5a708fa216488d4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.903601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9ea90-83f1-4a8b-9b95-49639bafb120 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.926621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa721-e0d2-49f0-a624-b5e43a2e143e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:07.938636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 210/412] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jul 26 07:39:07 2022] PUT /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4/groups/c72d4dea070a46f69f914cf77fb0162e/roles/b1f864ecbe4c43b4a5a708fa216488d4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:07.949028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee38ae-9f47-4530-8156-bacea534ef0c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.949677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee38ae-9f47-4530-8156-bacea534ef0c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.950147 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee38ae-9f47-4530-8156-bacea534ef0c None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.952151 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 211/413] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:39:07.957841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000c7b-5008-4230-9a3c-48f5cf66f83b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.958405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000c7b-5008-4230-9a3c-48f5cf66f83b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.958889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000c7b-5008-4230-9a3c-48f5cf66f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.969395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf2193-570f-4550-b653-978060ca32b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:07.970133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2193-570f-4550-b653-978060ca32b8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:07.970420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2193-570f-4550-b653-978060ca32b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:07.970698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2193-570f-4550-b653-978060ca32b8 None admin] PATH_INFO: `/v3/groups/fb4a7f2fe6204ff7aec9580cf870428b` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:07.972112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf2193-570f-4550-b653-978060ca32b8 None admin] RBAC: Authorizing `identity:get_group(group_id=fb4a7f2fe6204ff7aec9580cf870428b)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:07.973720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf2193-570f-4550-b653-978060ca32b8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:07.976173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 203/414] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:07 2022] GET /identity/v3/groups/fb4a7f2fe6204ff7aec9580cf870428b => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:07.987470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3c000c7b-5008-4230-9a3c-48f5cf66f83b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:07.988619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf2193-570f-4550-b653-978060ca32b8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:07.988809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3c000c7b-5008-4230-9a3c-48f5cf66f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:08.060102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:08.077183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 212/415] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:08.111643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000c7b-5008-4230-9a3c-48f5cf66f83b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:08.135850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:08.181638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf2193-570f-4550-b653-978060ca32b8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:08.231178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6e8c-4933-426e-a21f-237db00b5180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:08.232074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6e8c-4933-426e-a21f-237db00b5180 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:08.232359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6e8c-4933-426e-a21f-237db00b5180 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:08.232642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6e8c-4933-426e-a21f-237db00b5180 None admin] PATH_INFO: `/v3/projects/4e4e301f72114302a7a6060f88f11bb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:08.234897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e6e8c-4933-426e-a21f-237db00b5180 None admin] RBAC: Authorizing `identity:get_project(project_id=4e4e301f72114302a7a6060f88f11bb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:08.237092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e6e8c-4933-426e-a21f-237db00b5180 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:08.238997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 204/416] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:07 2022] GET /identity/v3/projects/4e4e301f72114302a7a6060f88f11bb3 => generated 344 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:08.246177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6e8c-4933-426e-a21f-237db00b5180 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:08.246744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000c7b-5008-4230-9a3c-48f5cf66f83b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:08.331648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65b61-a534-4b45-b5d0-2b32b9d5059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:08.332318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65b61-a534-4b45-b5d0-2b32b9d5059b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:08.332603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65b61-a534-4b45-b5d0-2b32b9d5059b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:08.332889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65b61-a534-4b45-b5d0-2b32b9d5059b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:08.375862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65b61-a534-4b45-b5d0-2b32b9d5059b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:08.377330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6e8c-4933-426e-a21f-237db00b5180 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-44c65b61-a534-4b45-b5d0-2b32b9d5059b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:08.380890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:08.381760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:08.382547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:08.391410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 213/417] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:08.397292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65b61-a534-4b45-b5d0-2b32b9d5059b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:08.413473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:08.419564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5824-8ebd-456f-8f31-9a2e9014bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:08.420538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5824-8ebd-456f-8f31-9a2e9014bf3e None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:08.420825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5824-8ebd-456f-8f31-9a2e9014bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:08.421106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5824-8ebd-456f-8f31-9a2e9014bf3e None admin] PATH_INFO: `/v3/projects/4e4e301f72114302a7a6060f88f11bb3/groups/fb4a7f2fe6204ff7aec9580cf870428b/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:08.424084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5824-8ebd-456f-8f31-9a2e9014bf3e None admin] RBAC: Authorizing `identity:create_grant(project_id=4e4e301f72114302a7a6060f88f11bb3, group_id=fb4a7f2fe6204ff7aec9580cf870428b, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:08.425824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5824-8ebd-456f-8f31-9a2e9014bf3e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:08.451357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 205/418] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jul 26 07:39:08 2022] PUT /identity/v3/projects/4e4e301f72114302a7a6060f88f11bb3/groups/fb4a7f2fe6204ff7aec9580cf870428b/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:08.454738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcebc8-646a-42b0-988e-62646e271d28 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:08.455060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcebc8-646a-42b0-988e-62646e271d28 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:08.457996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcebc8-646a-42b0-988e-62646e271d28 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:08.459807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 206/419] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:08.465703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64637ee-1d78-4772-acbb-7c33bb811756 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:08.466019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64637ee-1d78-4772-acbb-7c33bb811756 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:08.466306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64637ee-1d78-4772-acbb-7c33bb811756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:08.489741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:08.506625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c64637ee-1d78-4772-acbb-7c33bb811756 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:08.507928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c64637ee-1d78-4772-acbb-7c33bb811756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:08.607074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65b61-a534-4b45-b5d0-2b32b9d5059b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:08.632772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 207/420] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:08.658326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64637ee-1d78-4772-acbb-7c33bb811756 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:08.660544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:08.661176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:08.661465 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:08.661741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:08.662469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:08.662776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:08.666014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:08.677093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 214/421] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:39:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:08.683203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:08.808225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64637ee-1d78-4772-acbb-7c33bb811756 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:08.839596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:08.876412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfded65-7695-4694-98a9-bf84b496a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:08.877089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfded65-7695-4694-98a9-bf84b496a20e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:08.878080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfded65-7695-4694-98a9-bf84b496a20e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:08.878080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfded65-7695-4694-98a9-bf84b496a20e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:08.904398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfded65-7695-4694-98a9-bf84b496a20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:08.907032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a76aeb-5fa2-4e53-8762-f9f479d101e7 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-cdfded65-7695-4694-98a9-bf84b496a20e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:08.925286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:08.926226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:08.927048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:08.930915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 208/422] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:08.931312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:08.935522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfded65-7695-4694-98a9-bf84b496a20e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:08.963652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273bfa-e76b-40c3-a3bc-80fad31b2f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:08.964418 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273bfa-e76b-40c3-a3bc-80fad31b2f4c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:08.964769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273bfa-e76b-40c3-a3bc-80fad31b2f4c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:08.966455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273bfa-e76b-40c3-a3bc-80fad31b2f4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:09.096842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273bfa-e76b-40c3-a3bc-80fad31b2f4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:09.097084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273bfa-e76b-40c3-a3bc-80fad31b2f4c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:09.145107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfded65-7695-4694-98a9-bf84b496a20e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:09.228275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:09.230395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:09.231056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:09.232601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:09.234872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:09.237890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:09.239641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:09.261775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 209/423] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:09.267629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:09.318487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 215/424] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:09.324223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273bfa-e76b-40c3-a3bc-80fad31b2f4c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:09.347955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:09.374941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:09.527324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14657a72-89d4-40b0-94ac-098152ac8c2a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:09.561513 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273bfa-e76b-40c3-a3bc-80fad31b2f4c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:09.603243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c52462-36c3-46a7-b3ab-bdf3fb35acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:09.603793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c52462-36c3-46a7-b3ab-bdf3fb35acdd None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:09.604071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c52462-36c3-46a7-b3ab-bdf3fb35acdd None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:09.604345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c52462-36c3-46a7-b3ab-bdf3fb35acdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:09.640680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ccea1-2257-4239-b8e7-9f639f5b1379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:09.641323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccea1-2257-4239-b8e7-9f639f5b1379 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:09.643015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccea1-2257-4239-b8e7-9f639f5b1379 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:09.643015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccea1-2257-4239-b8e7-9f639f5b1379 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:09.645274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ccea1-2257-4239-b8e7-9f639f5b1379 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:09.646780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ccea1-2257-4239-b8e7-9f639f5b1379 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:09.653159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 216/425] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:09 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:09.660004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ccea1-2257-4239-b8e7-9f639f5b1379 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:09.754253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c52462-36c3-46a7-b3ab-bdf3fb35acdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:09.755735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c52462-36c3-46a7-b3ab-bdf3fb35acdd None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:09.812447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:09.843293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:09.868060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ccea1-2257-4239-b8e7-9f639f5b1379 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:09.934108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016145-2f86-4b0f-a833-6378edbe0f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:09.934767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016145-2f86-4b0f-a833-6378edbe0f09 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:09.935143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016145-2f86-4b0f-a833-6378edbe0f09 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:09.935424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016145-2f86-4b0f-a833-6378edbe0f09 None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:09.936818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016145-2f86-4b0f-a833-6378edbe0f09 None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:09.939416 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016145-2f86-4b0f-a833-6378edbe0f09 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:09.941602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 217/426] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:09 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:09.942833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0cf2e-a94d-444f-b1c3-79209f96bac9 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:09.943143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0cf2e-a94d-444f-b1c3-79209f96bac9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:09.943422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0cf2e-a94d-444f-b1c3-79209f96bac9 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:09.944892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 218/427] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:09.947600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0cf2e-a94d-444f-b1c3-79209f96bac9 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:09.959037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 210/428] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:09.960310 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d765a-72a3-4c99-8cfc-cfa97937f896 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:09.960594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d765a-72a3-4c99-8cfc-cfa97937f896 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:09.960876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d765a-72a3-4c99-8cfc-cfa97937f896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:09.985761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e28d765a-72a3-4c99-8cfc-cfa97937f896 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:09.986993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e28d765a-72a3-4c99-8cfc-cfa97937f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:10.069095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0cf2e-a94d-444f-b1c3-79209f96bac9 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:10.073362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 211/429] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:10.074409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d765a-72a3-4c99-8cfc-cfa97937f896 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:10.128503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:10.129690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.130421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.130917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.132293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] RBAC: Adding query filter params (group.id=c72d4dea070a46f69f914cf77fb0162e, role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:10.132811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:10.135055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:10.144793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 219/430] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:09 2022] GET /identity/v3/role_assignments?group.id=c72d4dea070a46f69f914cf77fb0162e&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:10.145887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:10.160778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:10.171541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:10.199828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d765a-72a3-4c99-8cfc-cfa97937f896 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:10.244244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31708-bb5b-40a7-9e4a-3a4897faace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:10.244917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31708-bb5b-40a7-9e4a-3a4897faace2 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.245195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31708-bb5b-40a7-9e4a-3a4897faace2 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.245470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31708-bb5b-40a7-9e4a-3a4897faace2 None admin] PATH_INFO: `/v3/projects/270803d5e32745d7be36c6fe3ecd55aa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.246953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31708-bb5b-40a7-9e4a-3a4897faace2 None admin] RBAC: Authorizing `identity:get_project(project_id=270803d5e32745d7be36c6fe3ecd55aa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:10.249726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31708-bb5b-40a7-9e4a-3a4897faace2 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:10.255981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 212/431] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:10 2022] GET /identity/v3/projects/270803d5e32745d7be36c6fe3ecd55aa => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:10.262099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31708-bb5b-40a7-9e4a-3a4897faace2 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:10.357404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295ea6-7a82-410d-a408-ac49ea6b3193 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:10.409420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5dfc-cb23-4db8-a052-b2264fa3ba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:10.410076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5dfc-cb23-4db8-a052-b2264fa3ba03 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.410360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5dfc-cb23-4db8-a052-b2264fa3ba03 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.410640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5dfc-cb23-4db8-a052-b2264fa3ba03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.427953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c5dfc-cb23-4db8-a052-b2264fa3ba03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-360c5dfc-cb23-4db8-a052-b2264fa3ba03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:10.434780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:10.435812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:10.436594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 220/432] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:10.437703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f722b-3527-40cf-982c-ca31685ed927 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.437808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f722b-3527-40cf-982c-ca31685ed927 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.438034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31708-bb5b-40a7-9e4a-3a4897faace2 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:10.438132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f722b-3527-40cf-982c-ca31685ed927 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.441289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 221/433] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:10.444777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f722b-3527-40cf-982c-ca31685ed927 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:10.489483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbfbc9-5c80-4faa-9d64-2fbf25de5aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:10.490174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbfbc9-5c80-4faa-9d64-2fbf25de5aed None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.490457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbfbc9-5c80-4faa-9d64-2fbf25de5aed None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.490742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbfbc9-5c80-4faa-9d64-2fbf25de5aed None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.491939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbfbc9-5c80-4faa-9d64-2fbf25de5aed None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:10.494513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbfbc9-5c80-4faa-9d64-2fbf25de5aed None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:10.496480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 213/434] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:10 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:10.497668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226764-a00b-4fbc-8747-a49e02f84663 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.497948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226764-a00b-4fbc-8747-a49e02f84663 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.498222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226764-a00b-4fbc-8747-a49e02f84663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.523680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c8226764-a00b-4fbc-8747-a49e02f84663 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:10.525563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c8226764-a00b-4fbc-8747-a49e02f84663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:10.529895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:10.532410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:10.576203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f722b-3527-40cf-982c-ca31685ed927 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:10.611080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 214/435] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:10.612185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226764-a00b-4fbc-8747-a49e02f84663 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:10.620295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:10.621180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.621699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.621983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.622811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] RBAC: Adding query filter params (name=member) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:10.623254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:10.624715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:10.634966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 222/436] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:39:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:10.641422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:10.733649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226764-a00b-4fbc-8747-a49e02f84663 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:10.759642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055f00b-ae60-4a99-912d-4f3920afc64a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:10.770839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:10.771428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.771707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.771979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.772761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] RBAC: Adding query filter params (group.id=c72d4dea070a46f69f914cf77fb0162e, role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=270803d5e32745d7be36c6fe3ecd55aa) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:10.773172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:10.774570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:10.790272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 215/437] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:10 2022] GET /identity/v3/role_assignments?group.id=c72d4dea070a46f69f914cf77fb0162e&scope.project.id=270803d5e32745d7be36c6fe3ecd55aa&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:10.790272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:10.790272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:10.809668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:10.819994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d11b2-8344-4fc3-87da-e7719a6f8dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:10.821893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d11b2-8344-4fc3-87da-e7719a6f8dab None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.822187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d11b2-8344-4fc3-87da-e7719a6f8dab None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.822463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d11b2-8344-4fc3-87da-e7719a6f8dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.904992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd0e8d-f5ce-4b68-8aa6-6c474739d268 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:10.913520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d11b2-8344-4fc3-87da-e7719a6f8dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:10.915067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d11b2-8344-4fc3-87da-e7719a6f8dab None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:10.943554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d290-01f5-4a72-bfd8-6dda42244251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:10.944779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d290-01f5-4a72-bfd8-6dda42244251 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.944779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d290-01f5-4a72-bfd8-6dda42244251 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.944779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d290-01f5-4a72-bfd8-6dda42244251 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.957719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56d290-01f5-4a72-bfd8-6dda42244251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-9d56d290-01f5-4a72-bfd8-6dda42244251 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:10.965703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:10.966852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 216/438] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:10.967688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529848-94cc-40e5-85ca-fcf44c8da706 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:10.972547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529848-94cc-40e5-85ca-fcf44c8da706 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:10.972547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4529848-94cc-40e5-85ca-fcf44c8da706 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:10.972547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 217/439] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:10.972547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4529848-94cc-40e5-85ca-fcf44c8da706 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.036671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 223/440] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 07:39:11.037743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb118-d2e3-46a9-93e1-e69ec6c22095 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.038034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb118-d2e3-46a9-93e1-e69ec6c22095 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.038312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb118-d2e3-46a9-93e1-e69ec6c22095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.044039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.059869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ab7bb118-d2e3-46a9-93e1-e69ec6c22095 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:11.061126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ab7bb118-d2e3-46a9-93e1-e69ec6c22095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:11.090980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4529848-94cc-40e5-85ca-fcf44c8da706 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.093114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.128799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.129437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.129726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.130006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.130729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:11.131079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.132460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:11.141930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 218/441] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:11.142728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 224/442] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:11.142979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.147868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bb118-d2e3-46a9-93e1-e69ec6c22095 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.250480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bb118-d2e3-46a9-93e1-e69ec6c22095 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.250879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2fb05-aa7e-4815-8db7-7d86730892ac None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.275708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.284938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f1851-06ba-41cb-b43c-f3ade3c4467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.285585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f1851-06ba-41cb-b43c-f3ade3c4467c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.285691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213db9af-a090-4974-8825-17a7463ef09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.285870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f1851-06ba-41cb-b43c-f3ade3c4467c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.286152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f1851-06ba-41cb-b43c-f3ade3c4467c None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.286243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db9af-a090-4974-8825-17a7463ef09f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.286481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db9af-a090-4974-8825-17a7463ef09f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.286807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db9af-a090-4974-8825-17a7463ef09f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.287357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f1851-06ba-41cb-b43c-f3ade3c4467c None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.288820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f1851-06ba-41cb-b43c-f3ade3c4467c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:11.290517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 219/443] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:11.291311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f1851-06ba-41cb-b43c-f3ade3c4467c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.317058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.354756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213db9af-a090-4974-8825-17a7463ef09f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.356243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213db9af-a090-4974-8825-17a7463ef09f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:11.391484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f1851-06ba-41cb-b43c-f3ade3c4467c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.424739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35278cd6-0519-41cf-919c-f4133297086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.425374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35278cd6-0519-41cf-919c-f4133297086b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.425661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35278cd6-0519-41cf-919c-f4133297086b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.425937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35278cd6-0519-41cf-919c-f4133297086b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.436634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35278cd6-0519-41cf-919c-f4133297086b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-35278cd6-0519-41cf-919c-f4133297086b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:11.442061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:11.442987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:11.443808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 220/444] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:11.444466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35278cd6-0519-41cf-919c-f4133297086b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.456601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 225/445] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 07:39:11.457593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213db9af-a090-4974-8825-17a7463ef09f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.499737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.520045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.544069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35278cd6-0519-41cf-919c-f4133297086b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.558794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213db9af-a090-4974-8825-17a7463ef09f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.576711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce898e-e565-468c-8a0d-4b9f1fcaf953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.577356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce898e-e565-468c-8a0d-4b9f1fcaf953 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.577644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce898e-e565-468c-8a0d-4b9f1fcaf953 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.577924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce898e-e565-468c-8a0d-4b9f1fcaf953 None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.579123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce898e-e565-468c-8a0d-4b9f1fcaf953 None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.580570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce898e-e565-468c-8a0d-4b9f1fcaf953 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:11.582172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 221/446] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:11.582950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce898e-e565-468c-8a0d-4b9f1fcaf953 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.597142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.598090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.598090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.598339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.599036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:11.599339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.600700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:11.609132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 226/447] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:11.609893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.686444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce898e-e565-468c-8a0d-4b9f1fcaf953 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.707958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.708503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f474c5-a1ae-44ed-8a9a-3a412d18ce31 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.720056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7389-3fe8-4038-8db0-335b53b4f19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.720694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7389-3fe8-4038-8db0-335b53b4f19b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.720977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7389-3fe8-4038-8db0-335b53b4f19b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.721253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7389-3fe8-4038-8db0-335b53b4f19b None admin] PATH_INFO: `/v3/projects/273944e75b144a7dac98dfa191ba1fa4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.722416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a7389-3fe8-4038-8db0-335b53b4f19b None admin] RBAC: Authorizing `identity:get_project(project_id=273944e75b144a7dac98dfa191ba1fa4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.723869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a7389-3fe8-4038-8db0-335b53b4f19b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:11.725508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 222/448] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/projects/273944e75b144a7dac98dfa191ba1fa4 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:11.726259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7389-3fe8-4038-8db0-335b53b4f19b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.732308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.744295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.744942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.745223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.745500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.746296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] RBAC: Adding query filter params (group.id=c72d4dea070a46f69f914cf77fb0162e, role.id=76ec473c1ae74b7880a67166a2fe69ab, scope.project.id=273944e75b144a7dac98dfa191ba1fa4) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:11.746623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.748082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:11.753913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 227/449] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/role_assignments?group.id=c72d4dea070a46f69f914cf77fb0162e&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=76ec473c1ae74b7880a67166a2fe69ab => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:11.754713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.851634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7389-3fe8-4038-8db0-335b53b4f19b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.881396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d2e98-79b0-4aad-a8aa-956f9a0e613d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:11.892006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf97f44-1b6b-4b8a-ba7e-00fb7f3cc2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.893407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf97f44-1b6b-4b8a-ba7e-00fb7f3cc2c2 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.894160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf97f44-1b6b-4b8a-ba7e-00fb7f3cc2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.894904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf97f44-1b6b-4b8a-ba7e-00fb7f3cc2c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.923002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01eab0-a52e-4491-8d7a-0c119fd7c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:11.923712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01eab0-a52e-4491-8d7a-0c119fd7c197 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:11.923996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01eab0-a52e-4491-8d7a-0c119fd7c197 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:11.924273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01eab0-a52e-4491-8d7a-0c119fd7c197 None admin] PATH_INFO: `/v3/groups/c72d4dea070a46f69f914cf77fb0162e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:11.925468 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01eab0-a52e-4491-8d7a-0c119fd7c197 None admin] RBAC: Authorizing `identity:get_group(group_id=c72d4dea070a46f69f914cf77fb0162e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.927927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01eab0-a52e-4491-8d7a-0c119fd7c197 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:11.928614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 228/450] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/groups/c72d4dea070a46f69f914cf77fb0162e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:11.935183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01eab0-a52e-4491-8d7a-0c119fd7c197 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:11.971332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:11.983768 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf97f44-1b6b-4b8a-ba7e-00fb7f3cc2c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:11.985237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf97f44-1b6b-4b8a-ba7e-00fb7f3cc2c2 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:12.008648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:12.059782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01eab0-a52e-4491-8d7a-0c119fd7c197 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:12.103918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:12.104122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:12.104390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:12.104621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:12.105419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] RBAC: Adding query filter params (group.id=c72d4dea070a46f69f914cf77fb0162e, role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=273944e75b144a7dac98dfa191ba1fa4) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:12.105734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:12.107351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:12.110515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 223/451] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:12.118952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf97f44-1b6b-4b8a-ba7e-00fb7f3cc2c2 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:12.119150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 229/452] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:11 2022] GET /identity/v3/role_assignments?group.id=c72d4dea070a46f69f914cf77fb0162e&scope.project.id=273944e75b144a7dac98dfa191ba1fa4&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:12.210180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:12.221408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf97f44-1b6b-4b8a-ba7e-00fb7f3cc2c2 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:12.256536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dddca-1d7a-4a34-8bdf-cebf4764974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:12.257188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dddca-1d7a-4a34-8bdf-cebf4764974e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:12.257467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dddca-1d7a-4a34-8bdf-cebf4764974e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:12.257743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dddca-1d7a-4a34-8bdf-cebf4764974e None admin] PATH_INFO: `/v3/projects/4e4e301f72114302a7a6060f88f11bb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:12.259465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dddca-1d7a-4a34-8bdf-cebf4764974e None admin] RBAC: Authorizing `identity:get_project(project_id=4e4e301f72114302a7a6060f88f11bb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:12.260899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dddca-1d7a-4a34-8bdf-cebf4764974e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:12.262577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 224/453] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:39:12 2022] GET /identity/v3/projects/4e4e301f72114302a7a6060f88f11bb3 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:12.268493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:12.372758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbcbec-f3fa-45db-ad90-9a47c7440be6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:12.394096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:12.409133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7b6b1-04d1-43fe-9e2b-72f39991f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:12.409769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7b6b1-04d1-43fe-9e2b-72f39991f62b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:12.410047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7b6b1-04d1-43fe-9e2b-72f39991f62b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:12.410322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7b6b1-04d1-43fe-9e2b-72f39991f62b None admin] PATH_INFO: `/v3/groups/fb4a7f2fe6204ff7aec9580cf870428b` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:12.411494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7b6b1-04d1-43fe-9e2b-72f39991f62b None admin] RBAC: Authorizing `identity:get_group(group_id=fb4a7f2fe6204ff7aec9580cf870428b)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:12.412946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7b6b1-04d1-43fe-9e2b-72f39991f62b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:12.414519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 230/454] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jul 26 07:39:12 2022] GET /identity/v3/groups/fb4a7f2fe6204ff7aec9580cf870428b => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:12.420619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dddca-1d7a-4a34-8bdf-cebf4764974e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:12.520712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dddca-1d7a-4a34-8bdf-cebf4764974e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:12.553899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49fa50-5ba1-45ae-888c-015ac6644f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:12.554518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49fa50-5ba1-45ae-888c-015ac6644f88 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:12.554804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49fa50-5ba1-45ae-888c-015ac6644f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:12.555119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49fa50-5ba1-45ae-888c-015ac6644f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:12.556431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49fa50-5ba1-45ae-888c-015ac6644f88 None admin] RBAC: Adding query filter params (group.id=fb4a7f2fe6204ff7aec9580cf870428b, role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=4e4e301f72114302a7a6060f88f11bb3) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:12.556747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49fa50-5ba1-45ae-888c-015ac6644f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:12.558260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49fa50-5ba1-45ae-888c-015ac6644f88 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:12.565668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 225/455] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jul 26 07:39:12 2022] GET /identity/v3/role_assignments?group.id=fb4a7f2fe6204ff7aec9580cf870428b&scope.project.id=4e4e301f72114302a7a6060f88f11bb3&role.id=53894f3146884908ba6dd3e118397fb3 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:14.888149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20b78-87f9-445b-9cce-0c2157200392 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:14.888995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20b78-87f9-445b-9cce-0c2157200392 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:14.889452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20b78-87f9-445b-9cce-0c2157200392 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:14.891259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 231/456] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:14.896393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b16e3-492e-4bfc-b6de-747d5157358f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:14.896834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b16e3-492e-4bfc-b6de-747d5157358f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:14.896922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b16e3-492e-4bfc-b6de-747d5157358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:14.920337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b86b16e3-492e-4bfc-b6de-747d5157358f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:14.921515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b86b16e3-492e-4bfc-b6de-747d5157358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:14.938895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:15.010038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 226/457] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:15.045683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b20b78-87f9-445b-9cce-0c2157200392 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:15.225781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b20b78-87f9-445b-9cce-0c2157200392 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:15.225976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4d43-67a3-4643-b496-0052db4b6d9d None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.226246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4d43-67a3-4643-b496-0052db4b6d9d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.226754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad4d43-67a3-4643-b496-0052db4b6d9d None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.228843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 227/458] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:15.233756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f0db6-9bd0-497b-aef9-897a6d7fce14 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.234263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f0db6-9bd0-497b-aef9-897a6d7fce14 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.234735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f0db6-9bd0-497b-aef9-897a6d7fce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.268744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-024f0db6-9bd0-497b-aef9-897a6d7fce14 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:15.270197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-024f0db6-9bd0-497b-aef9-897a6d7fce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:15.277701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:15.278354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.278632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.279134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.290762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:15.292515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:15.309413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:15.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:15.311189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:15.311189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:15.311189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:15.311189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:15.313815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 232/459] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:15.319105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:15.387372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:15.391210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 228/460] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:15.392601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517ae2-13a5-4dca-963e-5287962e6142 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.393080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517ae2-13a5-4dca-963e-5287962e6142 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.393367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517ae2-13a5-4dca-963e-5287962e6142 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.395040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 229/461] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:15.412246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a76a-7e63-4b2b-a3d1-4f8772342f25 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.412732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a76a-7e63-4b2b-a3d1-4f8772342f25 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.413161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a76a-7e63-4b2b-a3d1-4f8772342f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.438428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-78b4a76a-7e63-4b2b-a3d1-4f8772342f25 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:15.439860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-78b4a76a-7e63-4b2b-a3d1-4f8772342f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:15.451760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9ce72-a919-4026-ab9c-f28e77ca222d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:15.491045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:15.492973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.494029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.494796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.495788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:15.496527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:15.498633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:15.515153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 233/462] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:15.516080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:15.523160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 230/463] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:15.524269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4a76a-7e63-4b2b-a3d1-4f8772342f25 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:15.546914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:15.643104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:15.646638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2dd1b-6237-4f02-bb21-32825d45b734 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:15.659824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4a76a-7e63-4b2b-a3d1-4f8772342f25 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:15.683734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:15.684380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.684665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.684938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.695552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:15.697267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:15.698230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57487c-ce2f-46d7-9272-a7d385151904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:15.699112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57487c-ce2f-46d7-9272-a7d385151904 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.699606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57487c-ce2f-46d7-9272-a7d385151904 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.699881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57487c-ce2f-46d7-9272-a7d385151904 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.700572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57487c-ce2f-46d7-9272-a7d385151904 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:15.702008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57487c-ce2f-46d7-9272-a7d385151904 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:15.713252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:15.714196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:15.715078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:15.715078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:15.715078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:15.715078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:15.715078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 234/464] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:15.716067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:15.734966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 231/465] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:39:15 2022] POST /identity/v3/users => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:15.734966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86cc9-8a81-4eba-b4ac-5ec924bcd541 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.734966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86cc9-8a81-4eba-b4ac-5ec924bcd541 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.734966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86cc9-8a81-4eba-b4ac-5ec924bcd541 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.734966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 232/466] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:15.734966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86cc9-8a81-4eba-b4ac-5ec924bcd541 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:15.834647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:15.869449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e074aca-efde-446a-a993-7e12eb5daaba None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:15.884468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86cc9-8a81-4eba-b4ac-5ec924bcd541 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:15.920369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:15.921137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.921529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.921888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.925661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75706929-3e20-47cc-b919-0e0946bb2d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:15.926156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75706929-3e20-47cc-b919-0e0946bb2d09 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.926901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75706929-3e20-47cc-b919-0e0946bb2d09 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.926901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75706929-3e20-47cc-b919-0e0946bb2d09 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.927597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75706929-3e20-47cc-b919-0e0946bb2d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:15.927697 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75706929-3e20-47cc-b919-0e0946bb2d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:15.929079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75706929-3e20-47cc-b919-0e0946bb2d09 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:15.937861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:15.939973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:15.948670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 233/467] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:15.950273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439356e5-7000-4fcc-9375-7881b901f04a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:15.950564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439356e5-7000-4fcc-9375-7881b901f04a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:15.950843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439356e5-7000-4fcc-9375-7881b901f04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:15.960898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:15.961783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:15.962667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:15.962667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:15.962667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:15.962667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:15.962667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 235/468] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:15.962995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:15.968329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:15.979932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-439356e5-7000-4fcc-9375-7881b901f04a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:15.981382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-439356e5-7000-4fcc-9375-7881b901f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:16.054123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 234/469] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:16.055315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439356e5-7000-4fcc-9375-7881b901f04a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:16.088069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40fc9-2c53-4a20-8f80-33c0a7d946f0 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:16.123064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb4d1b-9bd3-48e1-9b9c-cbd15b785c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:16.123882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4d1b-9bd3-48e1-9b9c-cbd15b785c54 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.124641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4d1b-9bd3-48e1-9b9c-cbd15b785c54 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.124641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4d1b-9bd3-48e1-9b9c-cbd15b785c54 None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.125357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb4d1b-9bd3-48e1-9b9c-cbd15b785c54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:16.126938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb4d1b-9bd3-48e1-9b9c-cbd15b785c54 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:16.129969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:16.154199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 236/470] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:39:15 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:16.159406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb4d1b-9bd3-48e1-9b9c-cbd15b785c54 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:16.181380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439356e5-7000-4fcc-9375-7881b901f04a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:16.270250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:16.271206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.271631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.272507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.273570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:16.274076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:16.276861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:16.291958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 235/471] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:16.296531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:16.297684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:16.352995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb4d1b-9bd3-48e1-9b9c-cbd15b785c54 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:16.393601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:16.394881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.395351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.395787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.407839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:16.409542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:16.424898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:16.425933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:16.426871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:16.426871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:16.426871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:16.426871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:16.428724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 237/472] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:16.434886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:16.460972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf494d8-e39e-427e-a70a-9f49b8569b63 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:16.482318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:16.510136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42100900-398d-4c41-af02-3580245cf42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:16.510766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100900-398d-4c41-af02-3580245cf42f None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.511096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100900-398d-4c41-af02-3580245cf42f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.511378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100900-398d-4c41-af02-3580245cf42f None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.512179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42100900-398d-4c41-af02-3580245cf42f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:16.513758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42100900-398d-4c41-af02-3580245cf42f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:16.544868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 236/473] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:39:16 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:16.546630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287556-ee88-4b41-8376-98cf58c33755 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.547004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287556-ee88-4b41-8376-98cf58c33755 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.547290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287556-ee88-4b41-8376-98cf58c33755 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.550232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 237/474] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:16.554682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daadc07-b0ae-4991-beba-48427fbb3d73 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.555010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daadc07-b0ae-4991-beba-48427fbb3d73 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.555313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daadc07-b0ae-4991-beba-48427fbb3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.559859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c45b-e1cc-4ced-a866-36b1967d654b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:16.588649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0daadc07-b0ae-4991-beba-48427fbb3d73 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:16.589895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0daadc07-b0ae-4991-beba-48427fbb3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:16.593694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:16.639402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:16.639963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.640249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.640527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.641293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:16.641606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:16.643044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:16.671975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 238/475] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:16.674259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:16.745563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 238/476] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:16.775510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daadc07-b0ae-4991-beba-48427fbb3d73 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:16.836036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42752e9-fe2d-47ba-b6fc-85bb4fd8cf6a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:16.885968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9d328-e18f-419b-9fa0-8da8ee250ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:16.886606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d328-e18f-419b-9fa0-8da8ee250ab6 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.886890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d328-e18f-419b-9fa0-8da8ee250ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.887245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9d328-e18f-419b-9fa0-8da8ee250ab6 None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.887945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9d328-e18f-419b-9fa0-8da8ee250ab6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:16.889508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9d328-e18f-419b-9fa0-8da8ee250ab6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:16.917034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daadc07-b0ae-4991-beba-48427fbb3d73 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:16.923125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 239/477] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:39:16 2022] POST /identity/v3/users => generated 249 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:16.926888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:16.985203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:16.986217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:16.986640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:16.987091 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:16.987974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:16.989547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:17.009108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.sql.core [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 07:39:17.009108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 07:39:17.009108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [parameters: {'id': '2f5b480fd2384cf08748319a87be89ae', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 07:39:17.009108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91861) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result.read() Jul 26 07:39:17.026907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:39:17.027917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application yield resource Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise self.value Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application session.commit() Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 07:39:17.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.session.flush() Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application compat.raise_( Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 07:39:17.029679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:39:17.030560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result.read() Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:39:17.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [parameters: {'id': '2f5b480fd2384cf08748319a87be89ae', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:17.032213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 07:39:17.033053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:17.037378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 239/478] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jul 26 07:39:16 2022] POST /identity/v3/roles => generated 144 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:17.043956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9d328-e18f-419b-9fa0-8da8ee250ab6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:17.090971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:17.169911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9d328-e18f-419b-9fa0-8da8ee250ab6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:17.209499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e451e3c-8e4b-4f21-a8c7-94a0a0482895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:17.210164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e451e3c-8e4b-4f21-a8c7-94a0a0482895 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:17.210448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e451e3c-8e4b-4f21-a8c7-94a0a0482895 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:17.210725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e451e3c-8e4b-4f21-a8c7-94a0a0482895 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:17.222078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e451e3c-8e4b-4f21-a8c7-94a0a0482895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7e451e3c-8e4b-4f21-a8c7-94a0a0482895 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:17.227057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:17.228487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 07:39:17.229279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:17.232226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 240/479] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:17.234984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:17.349951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34264fff-88d1-4016-a17a-fc87ed8b998d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:17.399075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a42d6-b06a-4f9f-a8e1-8557286beb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:17.399751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a42d6-b06a-4f9f-a8e1-8557286beb17 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:17.400035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a42d6-b06a-4f9f-a8e1-8557286beb17 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:17.400308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a42d6-b06a-4f9f-a8e1-8557286beb17 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:17.401038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a42d6-b06a-4f9f-a8e1-8557286beb17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:17.401345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a42d6-b06a-4f9f-a8e1-8557286beb17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:17.402718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a42d6-b06a-4f9f-a8e1-8557286beb17 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:17.411451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 240/480] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:17.999981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3ccc-81bd-4c06-b7c6-0f0df99b8682 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:18.000477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3ccc-81bd-4c06-b7c6-0f0df99b8682 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:18.000571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3ccc-81bd-4c06-b7c6-0f0df99b8682 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:18.002215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 241/481] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:18.007656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f216-156c-4524-aecf-7e8ff02b6973 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:18.008069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f216-156c-4524-aecf-7e8ff02b6973 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:18.008232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f216-156c-4524-aecf-7e8ff02b6973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:18.036074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3086f216-156c-4524-aecf-7e8ff02b6973 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:18.037325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3086f216-156c-4524-aecf-7e8ff02b6973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:18.063692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:18.128488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 241/482] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:18.167019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc3ccc-81bd-4c06-b7c6-0f0df99b8682 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:18.275860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:18.294891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc3ccc-81bd-4c06-b7c6-0f0df99b8682 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:18.335811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f692-f4ff-4f21-acfc-8226b457d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:18.336459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f692-f4ff-4f21-acfc-8226b457d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:18.336745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f692-f4ff-4f21-acfc-8226b457d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:18.337056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249f692-f4ff-4f21-acfc-8226b457d4d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:18.347344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249f692-f4ff-4f21-acfc-8226b457d4d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7249f692-f4ff-4f21-acfc-8226b457d4d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:18.352930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:18.353886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:18.354681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 242/483] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:18.359921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f216-156c-4524-aecf-7e8ff02b6973 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:18.481324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f216-156c-4524-aecf-7e8ff02b6973 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:18.516853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:18.517495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:18.518066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:18.518346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:18.519121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:18.519690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:18.521125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:18.531188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 242/484] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:18.536206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f692-f4ff-4f21-acfc-8226b457d4d1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:18.657867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249f692-f4ff-4f21-acfc-8226b457d4d1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:18.706308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eb64e-3bb0-4296-af54-b86e83ec3788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:18.706984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb64e-3bb0-4296-af54-b86e83ec3788 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:18.707271 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb64e-3bb0-4296-af54-b86e83ec3788 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:18.707543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eb64e-3bb0-4296-af54-b86e83ec3788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:18.721058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eb64e-3bb0-4296-af54-b86e83ec3788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:18.722525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eb64e-3bb0-4296-af54-b86e83ec3788 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:18.735645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-d84eb64e-3bb0-4296-af54-b86e83ec3788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:18.745512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:18.746361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:18.747272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:18.747272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:18.747272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:18.747272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:18.747272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 243/485] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:18.752230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:18.799915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:18.816621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea03c-54ae-430b-9af0-eeeda34193dc None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:18.816942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea03c-54ae-430b-9af0-eeeda34193dc None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:18.817192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea03c-54ae-430b-9af0-eeeda34193dc None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:18.818806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 244/486] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:18.823760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2fc30-eb83-4dad-a2eb-77b4e4a80851 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:18.824049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2fc30-eb83-4dad-a2eb-77b4e4a80851 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:18.824333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2fc30-eb83-4dad-a2eb-77b4e4a80851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:18.879951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-eac2fc30-eb83-4dad-a2eb-77b4e4a80851 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:18.881167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-eac2fc30-eb83-4dad-a2eb-77b4e4a80851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:18.882139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed256b1-3d8f-4815-864c-87d30f9cde24 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:18.918278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:18.918995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:18.919278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:18.919549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:18.920321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:18.920632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:18.922012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:18.934874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 243/487] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:18.940579 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.028092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:19.047611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122aaf26-1e47-4a29-9fae-25a490dbae1c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:19.061201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 245/488] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:19.084674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2fc30-eb83-4dad-a2eb-77b4e4a80851 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.133487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:19.134713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.135025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.135304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.147052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:19.148565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:19.174165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:19.175137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:19.176039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:19.176536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 244/489] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:19.194519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.255242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2fc30-eb83-4dad-a2eb-77b4e4a80851 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:19.288847 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:19.293721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3f812-7d36-4a3c-b508-018093a8ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:19.294567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3f812-7d36-4a3c-b508-018093a8ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.295069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3f812-7d36-4a3c-b508-018093a8ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.295513 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3f812-7d36-4a3c-b508-018093a8ccd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.306781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3f812-7d36-4a3c-b508-018093a8ccd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-95d3f812-7d36-4a3c-b508-018093a8ccd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:19.311925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:19.312808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:19.313589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:19.316210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 246/490] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:19.317556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077253a-605e-411d-8df6-dcfe36463f8f None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.317997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077253a-605e-411d-8df6-dcfe36463f8f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.318423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077253a-605e-411d-8df6-dcfe36463f8f None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.320122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 247/491] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:19.322414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077253a-605e-411d-8df6-dcfe36463f8f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.339652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651b9f-4496-4072-b593-d87ee0468b6e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:19.375730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb81e24-01f3-4dcd-9560-54b4348d909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:19.376351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb81e24-01f3-4dcd-9560-54b4348d909d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.376637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb81e24-01f3-4dcd-9560-54b4348d909d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.376916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb81e24-01f3-4dcd-9560-54b4348d909d None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.377826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb81e24-01f3-4dcd-9560-54b4348d909d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:19.378162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb81e24-01f3-4dcd-9560-54b4348d909d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:19.379627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb81e24-01f3-4dcd-9560-54b4348d909d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:19.415504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:19.420899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 245/492] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:39:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:19.422077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f1d42-573d-4ac3-aedc-1f2a8171933e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.422360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f1d42-573d-4ac3-aedc-1f2a8171933e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.422646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f1d42-573d-4ac3-aedc-1f2a8171933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.433806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077253a-605e-411d-8df6-dcfe36463f8f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:19.442917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-430f1d42-573d-4ac3-aedc-1f2a8171933e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:19.444359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-430f1d42-573d-4ac3-aedc-1f2a8171933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:19.475369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:19.476325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.476777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.477245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.478177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:19.478696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:19.480386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:19.489572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 248/493] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:19.490713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.521123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 246/494] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:19.523828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f1d42-573d-4ac3-aedc-1f2a8171933e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.572864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:19.624855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8547af-2dd0-4719-a97e-bc869c4e5da4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:19.660500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0c64-53b9-4a9f-981a-3720e9382fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:19.661383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f1d42-573d-4ac3-aedc-1f2a8171933e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:19.661534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0c64-53b9-4a9f-981a-3720e9382fc0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.661952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0c64-53b9-4a9f-981a-3720e9382fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.662374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0c64-53b9-4a9f-981a-3720e9382fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.692594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:19.700598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:19.701250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.701532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.701807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.712411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:19.713898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:19.729169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:19.730008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:19.730847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:19.730847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:19.730847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:19.730847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:19.730847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 247/495] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:19.731596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.739488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc0c64-53b9-4a9f-981a-3720e9382fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:19.741092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc0c64-53b9-4a9f-981a-3720e9382fc0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:19.797277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:19.832590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbefc6c-15f3-438d-be9a-9f3f22459555 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:19.858255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 249/496] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:19.858255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be836-56a4-4b5d-a977-625981cf0549 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.858255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be836-56a4-4b5d-a977-625981cf0549 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.858255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be836-56a4-4b5d-a977-625981cf0549 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.858255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 250/497] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:19.858255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4be836-56a4-4b5d-a977-625981cf0549 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.873367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86fdae-9bf1-478f-887b-54ba2cee7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:19.874329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fdae-9bf1-478f-887b-54ba2cee7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:19.874329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fdae-9bf1-478f-887b-54ba2cee7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:19.874577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fdae-9bf1-478f-887b-54ba2cee7ea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:19.886672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86fdae-9bf1-478f-887b-54ba2cee7ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-ef86fdae-9bf1-478f-887b-54ba2cee7ea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:19.893468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:19.894605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 248/498] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:19.901033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86fdae-9bf1-478f-887b-54ba2cee7ea6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:19.944939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:19.972985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4be836-56a4-4b5d-a977-625981cf0549 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.006781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86fdae-9bf1-478f-887b-54ba2cee7ea6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.007287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79255af-a3f2-4952-91e4-ff06f5e5a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.007917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79255af-a3f2-4952-91e4-ff06f5e5a4e7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.008201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79255af-a3f2-4952-91e4-ff06f5e5a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.008481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79255af-a3f2-4952-91e4-ff06f5e5a4e7 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.009709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79255af-a3f2-4952-91e4-ff06f5e5a4e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:20.010096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79255af-a3f2-4952-91e4-ff06f5e5a4e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.011510 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79255af-a3f2-4952-91e4-ff06f5e5a4e7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.023041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 251/499] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:20.024342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24129890-4399-40fa-a838-f628b032bc53 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.025143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24129890-4399-40fa-a838-f628b032bc53 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.025642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24129890-4399-40fa-a838-f628b032bc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.041786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.042434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.042718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.043025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.043116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-24129890-4399-40fa-a838-f628b032bc53 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:20.044255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-24129890-4399-40fa-a838-f628b032bc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:20.051502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:20.054217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.056215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:20.070170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:20.071025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:20.072510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:20.072510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:20.072510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:20.072510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:20.072510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 249/500] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:20.072777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.115593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 252/501] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:20.116787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2c69-1d6d-44e4-95b8-e54639752983 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.117080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2c69-1d6d-44e4-95b8-e54639752983 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.117360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2c69-1d6d-44e4-95b8-e54639752983 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.119288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 253/502] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:20.119822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2c69-1d6d-44e4-95b8-e54639752983 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.170781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:20.177570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43803a54-ac5b-4044-99df-863afbd9aa6f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.211220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.211863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.212151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.212426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.213145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:20.213454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.214842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.222629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 250/503] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:20.223444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.231578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2c69-1d6d-44e4-95b8-e54639752983 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.265834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557df95-7672-4245-b660-bc6ed653bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.266472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557df95-7672-4245-b660-bc6ed653bc62 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.266755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557df95-7672-4245-b660-bc6ed653bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.267061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557df95-7672-4245-b660-bc6ed653bc62 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.274201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557df95-7672-4245-b660-bc6ed653bc62 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.275715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557df95-7672-4245-b660-bc6ed653bc62 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-e557df95-7672-4245-b660-bc6ed653bc62 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:20.288786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:20.289962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 254/504] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:20.291173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e68c-b81b-4281-be22-3e843ae62dae None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.291923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e68c-b81b-4281-be22-3e843ae62dae None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.291923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e68c-b81b-4281-be22-3e843ae62dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.297669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:20.311329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a8e9e68c-b81b-4281-be22-3e843ae62dae None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:20.312740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a8e9e68c-b81b-4281-be22-3e843ae62dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:20.328756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20636a-8ba4-4729-b58c-f6023da948e5 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.361867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960073b5-2185-4582-a574-001d1376da03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.362500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960073b5-2185-4582-a574-001d1376da03 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.362786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960073b5-2185-4582-a574-001d1376da03 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.363102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960073b5-2185-4582-a574-001d1376da03 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.363801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960073b5-2185-4582-a574-001d1376da03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:20.364112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960073b5-2185-4582-a574-001d1376da03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.365493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960073b5-2185-4582-a574-001d1376da03 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.377798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 251/505] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:20.378530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960073b5-2185-4582-a574-001d1376da03 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.386143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 255/506] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:20.387085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e68c-b81b-4281-be22-3e843ae62dae None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.402619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:20.485388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960073b5-2185-4582-a574-001d1376da03 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.485985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e68c-b81b-4281-be22-3e843ae62dae None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.515181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:20.520266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751011a1-650a-409d-afd2-1834af6615b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.520893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.521011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751011a1-650a-409d-afd2-1834af6615b3 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.521254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751011a1-650a-409d-afd2-1834af6615b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.521532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751011a1-650a-409d-afd2-1834af6615b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.521635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.521815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.522094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.532142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751011a1-650a-409d-afd2-1834af6615b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:20.532834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.534291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-751011a1-650a-409d-afd2-1834af6615b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:20.537116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:20.538138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:20.538995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 252/507] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:20.539796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751011a1-650a-409d-afd2-1834af6615b3 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:20.549662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:20.550727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:20.551615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:20.551615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:20.551615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:20.551615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:20.551615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 256/508] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:20.551615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.619211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:20.642358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751011a1-650a-409d-afd2-1834af6615b3 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.653877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ce792-504e-40fc-9749-7d026d4d5391 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.676117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.676720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.677004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.677280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.678071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:20.678379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.679857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.686599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.687269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.687545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.687817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.694304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.695749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.701343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 253/509] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:20.701343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:20.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:20.714356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 257/510] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:20.716341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.759235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:20.800450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf432df-6c75-4ca8-b762-f6bf3dd5045e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.815640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbe60b-1fc3-4ccd-9645-92f64d9adc9e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.834477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.835132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.835416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.835691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.837592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:20.848724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.850193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.853072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:20.853697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:20.853981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:20.854256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:20.854999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:20.855308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:20.856675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:20.864556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 258/511] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:20.865103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:20.866200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:20.867468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:20.867468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:20.867468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:20.867468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:20.867680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.867756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 254/512] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:20.867756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:20.967364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab8c09-95e9-475a-aeed-24ef5a21d149 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.967547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563827bb-6484-47c3-82d0-107e5f932903 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:20.974240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.000591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019af7-73a1-4b75-8b09-3f3caf6768c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.001212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019af7-73a1-4b75-8b09-3f3caf6768c4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.001491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019af7-73a1-4b75-8b09-3f3caf6768c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.001770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b019af7-73a1-4b75-8b09-3f3caf6768c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.002232 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.002845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.003163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.003437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.004119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:21.004586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.005964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.017727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 259/513] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:21.018390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.056357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.069738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019af7-73a1-4b75-8b09-3f3caf6768c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.071833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b019af7-73a1-4b75-8b09-3f3caf6768c4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.117137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b8cac-d05a-4dc5-ac84-fff5e4fdeacc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.150776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.151421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.151702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.151979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.152723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:21.153043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.154474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.168717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 255/514] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:21.169552 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019af7-73a1-4b75-8b09-3f3caf6768c4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.172757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 260/515] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:21.178080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.205725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.255161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.270121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b019af7-73a1-4b75-8b09-3f3caf6768c4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.277106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c8d2c-85f2-41b8-be02-8205e234f211 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.304072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671022-6692-424a-82f0-03473240171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.304731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671022-6692-424a-82f0-03473240171d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.305014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671022-6692-424a-82f0-03473240171d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.305294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671022-6692-424a-82f0-03473240171d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.310850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.311489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.311773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.312047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.312741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:21.313044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.314420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.315729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e671022-6692-424a-82f0-03473240171d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.317171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e671022-6692-424a-82f0-03473240171d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.325389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 261/516] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:21.326174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-6e671022-6692-424a-82f0-03473240171d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:21.332249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:21.333190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:21.334038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:21.334038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:21.334038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:21.334038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:21.334038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 256/517] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:21.334572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671022-6692-424a-82f0-03473240171d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.413081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.428812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91847c-a1f5-4fda-ab46-c3e320e2e019 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.435421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671022-6692-424a-82f0-03473240171d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.461735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.462370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.462655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.462955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.468188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.468819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.469105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.469385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.470309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.471774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.476395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.480853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.482284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:21.483484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:21.484368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:21.485261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 262/518] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:21.485817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:21.501439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:21.502420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:21.503291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:21.503291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:21.503291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:21.503291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:21.503291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 257/519] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:21.503777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.588494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a5800-73f7-45b6-9642-9c3f2129e307 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.600529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121a501-ca62-45ef-9546-4f215de81f00 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.621513 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.622137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.622424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.622703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.623533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=867e92c5301945a88e5c0ed06c4b7257) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:21.623847 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.625294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.639000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 263/520] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/role_assignments?user.id=867e92c5301945a88e5c0ed06c4b7257&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:21.639000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.639268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f684db-8f05-4f0e-b28a-f2ae4f379902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.639268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f684db-8f05-4f0e-b28a-f2ae4f379902 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.639268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f684db-8f05-4f0e-b28a-f2ae4f379902 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.639268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f684db-8f05-4f0e-b28a-f2ae4f379902 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.639574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f684db-8f05-4f0e-b28a-f2ae4f379902 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.639574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f684db-8f05-4f0e-b28a-f2ae4f379902 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.652110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.670754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 258/521] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:39:21 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:21.670754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f684db-8f05-4f0e-b28a-f2ae4f379902 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.765603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.780279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c42ed7-065c-4bb5-b383-32025d3d5b8d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.820882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.821660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.822010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.822365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.823234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:21.823675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.825387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.831235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f684db-8f05-4f0e-b28a-f2ae4f379902 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:21.840820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 264/522] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:21.846951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.879569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:21.880513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:21.881054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:21.881471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:21.882548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:21.882856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:21.884491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:21.908135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 259/523] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:21.910783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:21.938075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:21.982911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be317b-4ed7-4923-8ffe-491b669c684c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.021117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.022034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.022489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.022961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.023860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:22.024909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.026677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.036783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9953-42bd-4c30-bc83-4ca893aa2d93 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.039931 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 265/524] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:22.041076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:22.067322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:22.083585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.084248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.084576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.084859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.097089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.098884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:22.115922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:22.116979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:22.117854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 260/525] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:22.118955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:22.156370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae1f8f-196a-4d9d-b103-49dc128392cb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.186217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:22.193367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca767965-d0af-449b-89b8-6f6294ea5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.194239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767965-d0af-449b-89b8-6f6294ea5c3d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.194706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767965-d0af-449b-89b8-6f6294ea5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.195020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767965-d0af-449b-89b8-6f6294ea5c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.253316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfdb5a-804c-4645-8008-fa74b4a6145c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.278955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca767965-d0af-449b-89b8-6f6294ea5c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.280977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca767965-d0af-449b-89b8-6f6294ea5c3d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.289302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.289991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.290271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.290547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.297561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.299031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:22.311942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:22.313936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 261/526] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:22.316006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:22.345079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:22.419026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 266/527] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:22.419908 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca767965-d0af-449b-89b8-6f6294ea5c3d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:22.436506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7885c37-d939-4af6-a511-7d0705e3d286 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.457535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:22.485555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.486838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.487566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.487991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.489607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:22.490322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.492605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.522636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 262/528] 10.222.0.46 () {56 vars in 1139 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:22.524153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:22.535354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca767965-d0af-449b-89b8-6f6294ea5c3d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.573459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.574072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.574350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.574620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.575397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:22.575703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.577131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.594367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 267/529] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:22.594367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:22.643354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:22.670433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f39a-43e1-41b3-b51c-4f377541ad29 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.692676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:22.703569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f202a72-f0fd-40fe-afc3-94f9fbc0da64 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.720669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.721485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.721860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.722249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.734414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.737270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.744224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d7f3d-e870-4245-a26c-7f13fe9eedfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.745112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d7f3d-e870-4245-a26c-7f13fe9eedfc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.746110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d7f3d-e870-4245-a26c-7f13fe9eedfc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.746606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d7f3d-e870-4245-a26c-7f13fe9eedfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:22.754038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:22.754900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:22.755800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:22.755800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:22.755800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:22.755800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:22.760644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 263/530] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:22.761670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:22.833472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d7f3d-e870-4245-a26c-7f13fe9eedfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.836165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d7f3d-e870-4245-a26c-7f13fe9eedfc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.885094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e9aa-9416-40b9-a7d2-96942e7cf8b3 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:22.930522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:22.932554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:22.933051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:22.933957 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:22.935440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=c1886d36711f4ca48191ebfbee3e9a0f) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:22.936208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:22.938654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:22.941590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:22.947422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:22.953246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 264/531] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/role_assignments?user.id=c1886d36711f4ca48191ebfbee3e9a0f&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:22.953246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:22.973602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 268/532] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:22.979716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d7f3d-e870-4245-a26c-7f13fe9eedfc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:23.117125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d7f3d-e870-4245-a26c-7f13fe9eedfc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:23.156737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:23.158177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.158769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.159271 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.170519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9230-b0de-4fd8-8696-3dc2ce98bd5c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:23.172521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:23.174216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:23.192982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:23.193848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:23.194727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:23.194727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:23.194727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:23.194727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:23.197098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 269/533] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:23.202540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:23.217081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:23.217705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.218053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.218247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.218954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:23.219275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:23.220649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:23.239008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 265/534] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:23.240726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:23.259784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:23.348713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:23.370483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e9341-a1bc-491b-8a69-1fd53d2bba92 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:23.418673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e399f7-4b4b-48d4-bcc2-fc9db6ebbeea None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:23.433144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:23.433781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.434069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.434346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.436894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:23.437210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:23.438606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:23.463666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 270/535] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:23.470567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:23.488198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:23.488999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.489292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.489570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.503801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:23.505263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:23.528636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:23.529560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:23.530403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:23.530403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:23.530403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:23.530403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:23.530403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:23.530403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:23.530403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:23.530403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:23.535407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 266/536] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:23.540392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:23.658879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb638-7c0e-4253-a487-5ece5a6c9c17 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:23.667550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:23.697699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac6abb-7782-4829-b87a-e6380ea62d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:23.698734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6abb-7782-4829-b87a-e6380ea62d86 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.699262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6abb-7782-4829-b87a-e6380ea62d86 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.699730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6abb-7782-4829-b87a-e6380ea62d86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.707301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac6abb-7782-4829-b87a-e6380ea62d86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:23.708970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac6abb-7782-4829-b87a-e6380ea62d86 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:23.713516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6bf74-b733-4802-a5da-8b89387a182d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-71ac6abb-7782-4829-b87a-e6380ea62d86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:23.721947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:23.722768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:23.723649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:23.723649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:23.723649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:23.723649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:23.723649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:23.723649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:23.723649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:23.723649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:23.726143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 271/537] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:23.727661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a74525-fc1c-4f7c-b37f-788def40552d None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.728154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a74525-fc1c-4f7c-b37f-788def40552d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.728619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a74525-fc1c-4f7c-b37f-788def40552d None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.730063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 272/538] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:23.731167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a74525-fc1c-4f7c-b37f-788def40552d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:23.739094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:23.757095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569c090-5a1f-4128-9dd4-925e1d29f60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:23.757719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c090-5a1f-4128-9dd4-925e1d29f60d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.758047 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c090-5a1f-4128-9dd4-925e1d29f60d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.758327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569c090-5a1f-4128-9dd4-925e1d29f60d None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.759629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569c090-5a1f-4128-9dd4-925e1d29f60d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:23.759940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569c090-5a1f-4128-9dd4-925e1d29f60d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:23.761479 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569c090-5a1f-4128-9dd4-925e1d29f60d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:23.789240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 267/539] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:23.791871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccb8bb-1bfa-46e5-b794-f1460cb309cb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.793593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccb8bb-1bfa-46e5-b794-f1460cb309cb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.794838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccb8bb-1bfa-46e5-b794-f1460cb309cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.815403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-adccb8bb-1bfa-46e5-b794-f1460cb309cb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:23.816617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-adccb8bb-1bfa-46e5-b794-f1460cb309cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:23.854751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a74525-fc1c-4f7c-b37f-788def40552d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:23.891413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 268/540] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:23.892558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccb8bb-1bfa-46e5-b794-f1460cb309cb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:23.893213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:23.894049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:23.894891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:23.895455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:23.896478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:23.896980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:23.898726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:23.912169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 273/541] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:23.920854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:23.949081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:24.000959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccb8bb-1bfa-46e5-b794-f1460cb309cb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:24.012297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:24.035234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541320-a389-486b-9ccb-0571e8fcf10d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:24.038295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:24.038904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.039205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.039478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.040288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=bde6248cf0794fab88a093097b597c9a) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:24.040595 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:24.042022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:24.048000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 269/542] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:23 2022] GET /identity/v3/role_assignments?user.id=bde6248cf0794fab88a093097b597c9a&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:24.057272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:24.073433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093dba9-6d32-4afd-931f-b2acdeffc857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:24.074122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093dba9-6d32-4afd-931f-b2acdeffc857 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.074400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093dba9-6d32-4afd-931f-b2acdeffc857 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.074671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093dba9-6d32-4afd-931f-b2acdeffc857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.075551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093dba9-6d32-4afd-931f-b2acdeffc857 None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=77a234b8e5f2472cb3e733f933ca1f4e) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:24.075863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093dba9-6d32-4afd-931f-b2acdeffc857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:24.077415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093dba9-6d32-4afd-931f-b2acdeffc857 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:24.084208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 274/543] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:23 2022] GET /identity/v3/role_assignments?user.id=77a234b8e5f2472cb3e733f933ca1f4e&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:24.085527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d156-9c0a-4488-882e-c8ed6575c0d3 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.085814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d156-9c0a-4488-882e-c8ed6575c0d3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.086142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d156-9c0a-4488-882e-c8ed6575c0d3 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.087723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 275/544] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:24.093610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1f027-5e4e-40e3-aaeb-aee903dc0ae2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.093934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1f027-5e4e-40e3-aaeb-aee903dc0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.094168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1f027-5e4e-40e3-aaeb-aee903dc0ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.128790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9be1f027-5e4e-40e3-aaeb-aee903dc0ae2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:24.130090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9be1f027-5e4e-40e3-aaeb-aee903dc0ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:24.249401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 276/545] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:24.254650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9afa1-8d9d-452a-98a4-808a1da838d1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:24.287469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1f027-5e4e-40e3-aaeb-aee903dc0ae2 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:24.302201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fafe-cea4-474b-9d15-9b68a363e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:24.302610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fafe-cea4-474b-9d15-9b68a363e74e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.302892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fafe-cea4-474b-9d15-9b68a363e74e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.303191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fafe-cea4-474b-9d15-9b68a363e74e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.314681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19fafe-cea4-474b-9d15-9b68a363e74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:24.315090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-dd19fafe-cea4-474b-9d15-9b68a363e74e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:24.319852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:24.320800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:24.322337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 270/546] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:24.327350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fafe-cea4-474b-9d15-9b68a363e74e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:24.361930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:24.439094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fafe-cea4-474b-9d15-9b68a363e74e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:24.479095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:24.479726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.480023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.480296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.481012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:24.481318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:24.482690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:24.491316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 271/547] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:24.496864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:24.509689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1f027-5e4e-40e3-aaeb-aee903dc0ae2 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:24.601051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:24.603930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75170-3644-4b30-9963-4ac34d5d1233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:24.604586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75170-3644-4b30-9963-4ac34d5d1233 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.604869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75170-3644-4b30-9963-4ac34d5d1233 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.605144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75170-3644-4b30-9963-4ac34d5d1233 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.607323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18583-64a2-4784-9c54-7d2054438134 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:24.624459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e75170-3644-4b30-9963-4ac34d5d1233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-c7e75170-3644-4b30-9963-4ac34d5d1233 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:24.629454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:24.630336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:24.631544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 277/548] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:24.637211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75170-3644-4b30-9963-4ac34d5d1233 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:24.678484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:24.679171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.679460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.679739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.693015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:24.694610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:24.712801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:24.714915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:24.717642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:24.717642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:24.717642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:24.717642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:24.717642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 272/549] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:24.722747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:24.722902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:24.762006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75170-3644-4b30-9963-4ac34d5d1233 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:24.828535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:24.829164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.829448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.829723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.830449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:24.830759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:24.834614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:24.851524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 278/550] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:24.857124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:24.912049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191fc4b-31fa-484c-ae90-20d898a91273 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:24.974427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:24.975083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:24.975365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:24.975638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:24.976335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:24.976638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:24.978539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.003111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 273/551] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:25.008232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.028833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:25.043084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb993-2893-43ac-9bb2-30a60cc7917a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.106509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.107182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.107520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.107799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.116974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:25.124120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.125582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:25.152392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:25.153391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:25.154331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:25.154331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:25.154331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:25.154331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:25.154331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 279/552] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:25.159849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.189914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4330221-0591-4064-86f2-b3163f9adac9 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.249873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.250521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.250801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.251100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.264315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.266006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:25.286880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:25.288002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:25.289100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:25.293881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 274/553] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:25.299986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.335888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e88ab-ce18-4b7f-bfaf-a064002f2216 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.375461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:25.382366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2442e-b345-48ac-aba0-91f4ef443c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.383133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2442e-b345-48ac-aba0-91f4ef443c19 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.383423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2442e-b345-48ac-aba0-91f4ef443c19 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.383835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2442e-b345-48ac-aba0-91f4ef443c19 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.384711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2442e-b345-48ac-aba0-91f4ef443c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:25.385023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2442e-b345-48ac-aba0-91f4ef443c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.386410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2442e-b345-48ac-aba0-91f4ef443c19 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.401637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 280/554] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:25.402906 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867eef2-8882-40a9-9d4b-890ecd0603b4 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.407730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867eef2-8882-40a9-9d4b-890ecd0603b4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.408022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867eef2-8882-40a9-9d4b-890ecd0603b4 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.409737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 281/555] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:25.410495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867eef2-8882-40a9-9d4b-890ecd0603b4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.415695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac87cff-c319-4bc0-b5ca-c4a8a04ad14f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.451282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c8f7c-7e1f-42cf-87ab-f19f6c1eb190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.452201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c8f7c-7e1f-42cf-87ab-f19f6c1eb190 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.452631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c8f7c-7e1f-42cf-87ab-f19f6c1eb190 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.453049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c8f7c-7e1f-42cf-87ab-f19f6c1eb190 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.454029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c8f7c-7e1f-42cf-87ab-f19f6c1eb190 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:25.454495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c8f7c-7e1f-42cf-87ab-f19f6c1eb190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.456295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c8f7c-7e1f-42cf-87ab-f19f6c1eb190 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.470664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:25.477234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 275/556] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:25.479458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8cb11-5845-44b4-ad0b-332ce9107e82 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.479952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8cb11-5845-44b4-ad0b-332ce9107e82 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.480452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8cb11-5845-44b4-ad0b-332ce9107e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.498240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c2a8cb11-5845-44b4-ad0b-332ce9107e82 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:25.499807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c2a8cb11-5845-44b4-ad0b-332ce9107e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:25.528063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867eef2-8882-40a9-9d4b-890ecd0603b4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.566690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.567350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.567720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.568016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.569711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 276/557] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:25.570841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8cb11-5845-44b4-ad0b-332ce9107e82 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.575907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.577415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:25.590374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:25.592064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:25.592998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 282/558] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:25.599238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.631144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:25.678866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8cb11-5845-44b4-ad0b-332ce9107e82 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.712370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e715015-6a30-4b67-b158-4b4601372574 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.715025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.715915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.716390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.716856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.724445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:25.727898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.729612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:25.745052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:25.746031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:25.746907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:25.746907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:25.746907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:25.746907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:25.748841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 277/559] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:25.749761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.752595 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.753337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.754385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.754385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.755059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:25.755506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.757051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.800859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 283/560] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:25.801929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.859333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d7094-7983-451b-ad2c-3dab666cab07 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.866911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:25.896994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296733f-0e2f-4e94-84a3-9a4c1efa812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.897915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296733f-0e2f-4e94-84a3-9a4c1efa812a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.898354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296733f-0e2f-4e94-84a3-9a4c1efa812a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.898771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296733f-0e2f-4e94-84a3-9a4c1efa812a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.910141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296733f-0e2f-4e94-84a3-9a4c1efa812a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-f296733f-0e2f-4e94-84a3-9a4c1efa812a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:25.915748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:25.916840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:25.917754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:25.920341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b0720-3bb7-4edd-8f5e-874315049855 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:25.920530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 278/561] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:25.921539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296733f-0e2f-4e94-84a3-9a4c1efa812a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:25.966039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:25.966897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:25.967469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:25.967975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:25.969360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:25.969924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:25.971893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:25.986796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 284/562] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:25.988201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.024235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:26.029010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296733f-0e2f-4e94-84a3-9a4c1efa812a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.065210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d616391-bd4a-480b-a250-5059c2e6cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.066221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616391-bd4a-480b-a250-5059c2e6cf92 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.066745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616391-bd4a-480b-a250-5059c2e6cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.067249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616391-bd4a-480b-a250-5059c2e6cf92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.102632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:26.115265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471894-3ea3-446a-8de9-378cbaf39994 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.140659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d616391-bd4a-480b-a250-5059c2e6cf92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.142406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d616391-bd4a-480b-a250-5059c2e6cf92 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.159313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.160350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.160797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.161245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.162591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:26.163111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.165223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.175971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 285/563] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:26.177270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.247463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 279/564] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:26.248633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d616391-bd4a-480b-a250-5059c2e6cf92 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.296567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:26.308036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9134e-c671-4a3c-b858-93ba80bf68ec None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.341232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:26.350902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.351721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.352492 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.352862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.358279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d616391-bd4a-480b-a250-5059c2e6cf92 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.361979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.363973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:26.381015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:26.381923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:26.382776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:26.382776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:26.382776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:26.382776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:26.382776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:26.382776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:26.382776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:26.382776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:26.383245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 286/565] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:26.384718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.399866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebf6f3-4cd1-4216-be5e-aca9f821bfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.400517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebf6f3-4cd1-4216-be5e-aca9f821bfb1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.400801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebf6f3-4cd1-4216-be5e-aca9f821bfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.401073 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebf6f3-4cd1-4216-be5e-aca9f821bfb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.412074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebf6f3-4cd1-4216-be5e-aca9f821bfb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.413520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebf6f3-4cd1-4216-be5e-aca9f821bfb1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-4eebf6f3-4cd1-4216-be5e-aca9f821bfb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:26.427683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:26.428593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:26.429485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:26.429485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:26.429485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:26.429485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:26.429485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 280/566] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:26.430060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085657-f838-4d79-bdca-fbde48572c06 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.430249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085657-f838-4d79-bdca-fbde48572c06 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.431067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085657-f838-4d79-bdca-fbde48572c06 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.432425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 281/567] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:26.434822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed085657-f838-4d79-bdca-fbde48572c06 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.487495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a65b-5766-494f-912c-5bf74f51232d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.521607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e9803-108a-44e0-b8fe-b64d2004084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.522249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e9803-108a-44e0-b8fe-b64d2004084e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.522531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e9803-108a-44e0-b8fe-b64d2004084e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.522809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e9803-108a-44e0-b8fe-b64d2004084e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.534522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e9803-108a-44e0-b8fe-b64d2004084e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.536026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e9803-108a-44e0-b8fe-b64d2004084e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.537065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed085657-f838-4d79-bdca-fbde48572c06 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-503e9803-108a-44e0-b8fe-b64d2004084e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:26.551057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:26.552008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:26.553293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:26.553293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:26.553293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:26.553293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:26.553293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 287/568] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:26.553820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767500-74bb-4f36-9ae7-cd0e44f45c27 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.554096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767500-74bb-4f36-9ae7-cd0e44f45c27 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.554368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5767500-74bb-4f36-9ae7-cd0e44f45c27 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.555776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 288/569] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:26.556676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5767500-74bb-4f36-9ae7-cd0e44f45c27 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.559005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:26.559569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:26.577881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dfdda-e95d-4417-889b-6905b1beb75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.578509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dfdda-e95d-4417-889b-6905b1beb75b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.578809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dfdda-e95d-4417-889b-6905b1beb75b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.579111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dfdda-e95d-4417-889b-6905b1beb75b None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.579878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dfdda-e95d-4417-889b-6905b1beb75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:26.580187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dfdda-e95d-4417-889b-6905b1beb75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.581637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dfdda-e95d-4417-889b-6905b1beb75b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.594949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 282/570] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:26.596145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9b738-7a20-41cf-aaa0-712b7a29e513 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.596454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9b738-7a20-41cf-aaa0-712b7a29e513 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.596760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9b738-7a20-41cf-aaa0-712b7a29e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.613597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-4ef9b738-7a20-41cf-aaa0-712b7a29e513 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:26.614747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4ef9b738-7a20-41cf-aaa0-712b7a29e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:26.667075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5767500-74bb-4f36-9ae7-cd0e44f45c27 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.680997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 283/571] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:26.681756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9b738-7a20-41cf-aaa0-712b7a29e513 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.708308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ac9f6-e002-4d02-8c7c-d5ecab0385b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.708936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac9f6-e002-4d02-8c7c-d5ecab0385b3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.709225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac9f6-e002-4d02-8c7c-d5ecab0385b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.709505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac9f6-e002-4d02-8c7c-d5ecab0385b3 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.710475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ac9f6-e002-4d02-8c7c-d5ecab0385b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:26.710475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ac9f6-e002-4d02-8c7c-d5ecab0385b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.712557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ac9f6-e002-4d02-8c7c-d5ecab0385b3 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.725266 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 289/572] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:26.726683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2b2d0-cd0c-4019-a81d-dfea2d79ec3c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.727237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2b2d0-cd0c-4019-a81d-dfea2d79ec3c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.728056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2b2d0-cd0c-4019-a81d-dfea2d79ec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.745451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9aa2b2d0-cd0c-4019-a81d-dfea2d79ec3c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:26.746647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9aa2b2d0-cd0c-4019-a81d-dfea2d79ec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:26.787119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9b738-7a20-41cf-aaa0-712b7a29e513 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.796847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:26.803921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:26.815305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 290/573] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:26.816072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2b2d0-cd0c-4019-a81d-dfea2d79ec3c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.822568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.823229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.823517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.823797 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.824499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:26.824811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.826198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.841345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 284/574] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:26.841345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.924329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2b2d0-cd0c-4019-a81d-dfea2d79ec3c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.938952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b0c06-ec1b-4964-89c2-0bd61cbf965f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:26.957046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14b3a5-9c5f-4c32-9747-a1129ea71f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.957720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14b3a5-9c5f-4c32-9747-a1129ea71f88 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.958009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14b3a5-9c5f-4c32-9747-a1129ea71f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.958288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14b3a5-9c5f-4c32-9747-a1129ea71f88 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/867e92c5301945a88e5c0ed06c4b7257/roles/a30240f5fb7d4b76a899eaed2f4cf878` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.971730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209448-f8f6-47e4-8d2a-5bf47a74e6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:26.972360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209448-f8f6-47e4-8d2a-5bf47a74e6ec None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:26.972640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209448-f8f6-47e4-8d2a-5bf47a74e6ec None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:26.972911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209448-f8f6-47e4-8d2a-5bf47a74e6ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:26.973289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14b3a5-9c5f-4c32-9747-a1129ea71f88 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=867e92c5301945a88e5c0ed06c4b7257, role_id=a30240f5fb7d4b76a899eaed2f4cf878)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:26.974741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14b3a5-9c5f-4c32-9747-a1129ea71f88 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:26.983860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9209448-f8f6-47e4-8d2a-5bf47a74e6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:26.988534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 291/575] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:39:26 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/867e92c5301945a88e5c0ed06c4b7257/roles/a30240f5fb7d4b76a899eaed2f4cf878 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:26.989322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14b3a5-9c5f-4c32-9747-a1129ea71f88 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-e9209448-f8f6-47e4-8d2a-5bf47a74e6ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:26.989429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:26.990267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:26.991128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 285/576] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:26.991832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209448-f8f6-47e4-8d2a-5bf47a74e6ec None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.039536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:27.044724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:27.115864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14b3a5-9c5f-4c32-9747-a1129ea71f88 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.129677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209448-f8f6-47e4-8d2a-5bf47a74e6ec None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.158701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.159385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.159673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.159976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.168333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.169225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa69ed7-24aa-4369-a7f7-7d5f748106bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.169791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.169896 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69ed7-24aa-4369-a7f7-7d5f748106bb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.170188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69ed7-24aa-4369-a7f7-7d5f748106bb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.170448 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69ed7-24aa-4369-a7f7-7d5f748106bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.181573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa69ed7-24aa-4369-a7f7-7d5f748106bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:27.181834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:27.182710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 292/577] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:27.183747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-afa69ed7-24aa-4369-a7f7-7d5f748106bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:27.186998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:27.187905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 286/578] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:27.189780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa69ed7-24aa-4369-a7f7-7d5f748106bb None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.282306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:27.296547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa69ed7-24aa-4369-a7f7-7d5f748106bb None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.304730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681591-a924-41c9-8365-537dbeb329ca None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.306778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:27.333901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.334534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.334819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.335144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.335876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:27.336188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.338155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.342140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.342786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.343099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.343720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.347028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 287/579] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:27.350288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.351766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.352263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:27.363736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:27.364733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 293/580] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:27.365631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.462330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e918cc-e31d-4f03-92c4-9f19d23c52fc None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.476144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b732a8-1f56-4d2c-b518-4903e9898922 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.495616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.496247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.496531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.496814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.497616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:27.497929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.501736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.517355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.518093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.518583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.518871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.519893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:27.520204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.521058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 288/581] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:27.521599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.522198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.533507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 294/582] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:27.534328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.538368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:27.562009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:27.636900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247e69-25b4-4c28-b3e3-68138d225110 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.640574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fc038-2b79-4fe0-8d44-7278e70bb8ab None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.672589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.673241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.673626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.674160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.679641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.680270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.681066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.681342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.682096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:27.682406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.683929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.685891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.687383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.697084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 295/583] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:27.702016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:27.708736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:27.709636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:27.710511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:27.710511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:27.710511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:27.710511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:27.710511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 289/584] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:27.711460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.780563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:27.786491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:27.804786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350bb3-f8fb-46f5-bac1-f7d040040a60 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.827585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891873ed-83b8-4b96-a05c-ce12f0fc42ae None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:27.840999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.841648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.841933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.842209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.855481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.857029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.868978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:27.869623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:27.869906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:27.870182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:27.873098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:27.874131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:27.875236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:27.875236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:27.875236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:27.875236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:27.878860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 296/585] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:27.879698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.884575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:27.886075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:27.902002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:27.902892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:27.903928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:27.903928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:27.903928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:27.903928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:27.907911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 290/586] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:27.908563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:27.993319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747eda-727b-470a-bafd-057133c5865e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.010680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba39d-79dd-4c35-8ce1-8708e37b9132 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.025428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:28.030078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.030848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.031028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.031285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.032077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=de1dd35abd2e4db0bda795191eeee287) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:28.032390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.033884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.037476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:28.042319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 297/587] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/role_assignments?user.id=de1dd35abd2e4db0bda795191eeee287&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:28.043286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.064729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.065907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.066761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.067287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.068230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:28.068728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.071620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.088148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 291/588] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:28.089391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.164714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae93baf-d823-4ec9-9e5c-8b48af2152e1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.202169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.202816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.203145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.203420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.204130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:28.204438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.205923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.218762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e240a6-06fc-4a79-8e3e-d44b11135c53 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.224565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 298/589] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:28.224565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.277548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.278656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.278958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.279283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.280393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:28.281032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.282613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.297242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:28.299554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 292/590] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:28.301261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.343541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:28.350968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3867-62ff-466c-8352-740e518f1707 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.399457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.401420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.401880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.402342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.414057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.416439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.417298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c183b4c-0b55-4cc0-a0d6-c5f68f379047 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:28.433904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:28.434909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:39:28.436025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:28.443243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 299/591] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:28.443933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.459909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.460546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.460879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.461158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.468401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.469941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:28.481962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:28.483649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 293/592] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:28.484551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.583749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb9f51-c101-494c-bd7b-cb37b10490c2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.586773 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:28.598457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f1aa-fd87-4283-9018-efd03d4bac81 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.613224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:28.633378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.634545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.635076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.635493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.635754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.636490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.636853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.637233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.638195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:28.638533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.640159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.646560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.648479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.664082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 294/593] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:28.664082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:28.666486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:28.667426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:39:28.668373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:28.671564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 300/594] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:28.671772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.772269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5443784-370b-4d0f-847f-96312c5e8cd9 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.810315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.810965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.811270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.811548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.812301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:28.812591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b45a95-febd-4a4c-9fea-06e6f2f1e212 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.812709 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.814027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.827584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 295/595] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:28.828428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.849701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:28.859112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.860042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.860521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.860986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.876375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.878122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:28.897097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:28.897985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:28.898876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:28.898876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:28.898876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:28.898876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:28.905536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 301/596] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:28.905536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:28.947627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:28.952187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9341ea-1183-4c11-8b1e-0b784d59dde0 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:28.988329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:28.988957 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:28.989243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:28.989522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:28.990696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:28.990696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:28.992095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:29.010461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 296/597] 10.222.0.46 () {56 vars in 1139 bytes} [Tue Jul 26 07:39:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:29.011524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.028858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210d041-f6db-4cf1-b9d1-d2f4b9df1ecc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:29.065230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee10d3f-713b-42df-8ae7-620662a967ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:29.066243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10d3f-713b-42df-8ae7-620662a967ff None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.066534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10d3f-713b-42df-8ae7-620662a967ff None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.066813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10d3f-713b-42df-8ae7-620662a967ff None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/c1886d36711f4ca48191ebfbee3e9a0f/roles/a30240f5fb7d4b76a899eaed2f4cf878` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.081507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:29.083491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee10d3f-713b-42df-8ae7-620662a967ff None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=c1886d36711f4ca48191ebfbee3e9a0f, role_id=a30240f5fb7d4b76a899eaed2f4cf878)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:29.085166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee10d3f-713b-42df-8ae7-620662a967ff None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:29.098720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 302/598] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:39:28 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/c1886d36711f4ca48191ebfbee3e9a0f/roles/a30240f5fb7d4b76a899eaed2f4cf878 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:29.099506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee10d3f-713b-42df-8ae7-620662a967ff None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.126764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcef78a-90d1-429d-b050-4f91b072370e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:29.176038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefadc1-bc3c-4753-94be-d378f135e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:29.177295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefadc1-bc3c-4753-94be-d378f135e964 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.177731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefadc1-bc3c-4753-94be-d378f135e964 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.178392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefadc1-bc3c-4753-94be-d378f135e964 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.179345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefadc1-bc3c-4753-94be-d378f135e964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:29.179751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefadc1-bc3c-4753-94be-d378f135e964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:29.182162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefadc1-bc3c-4753-94be-d378f135e964 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:29.202542 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 297/599] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:29.204764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1db72-6563-40b4-af72-ea80e96473b5 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.205224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1db72-6563-40b4-af72-ea80e96473b5 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.205651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1db72-6563-40b4-af72-ea80e96473b5 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.207551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:29.213699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 298/600] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:29.215070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1db72-6563-40b4-af72-ea80e96473b5 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.233935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee10d3f-713b-42df-8ae7-620662a967ff None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:29.287994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ea324-e03c-40d9-b357-303cccf53efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:29.288648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea324-e03c-40d9-b357-303cccf53efc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.288930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea324-e03c-40d9-b357-303cccf53efc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.289204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea324-e03c-40d9-b357-303cccf53efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.300814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ea324-e03c-40d9-b357-303cccf53efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:29.302379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ea324-e03c-40d9-b357-303cccf53efc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-1e1ea324-e03c-40d9-b357-303cccf53efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:29.318414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:29.319385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:29.320697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:29.320697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:29.320697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:29.320697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:29.320697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 303/601] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:29.321632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f946-aced-417c-a167-ba94556e1b77 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.321920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f946-aced-417c-a167-ba94556e1b77 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.322195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f946-aced-417c-a167-ba94556e1b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.345053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-80e8f946-aced-417c-a167-ba94556e1b77 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:29.346301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-80e8f946-aced-417c-a167-ba94556e1b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:29.355390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1db72-6563-40b4-af72-ea80e96473b5 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:29.383359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:29.393833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3d488-c872-428a-b463-25d699997516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:29.394732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3d488-c872-428a-b463-25d699997516 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.395053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3d488-c872-428a-b463-25d699997516 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.395328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3d488-c872-428a-b463-25d699997516 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.403863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3d488-c872-428a-b463-25d699997516 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:29.405730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3d488-c872-428a-b463-25d699997516 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-52f3d488-c872-428a-b463-25d699997516 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:29.420000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:29.421665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 299/602] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:29.422825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3d488-c872-428a-b463-25d699997516 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.443273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 304/603] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:29.443273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f946-aced-417c-a167-ba94556e1b77 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.501816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:29.543726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f946-aced-417c-a167-ba94556e1b77 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:29.562379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3d488-c872-428a-b463-25d699997516 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:29.587015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:29.587660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.588199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.588480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.589924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:29.590245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:29.592454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:29.599695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:29.600320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.600703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.601170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.601867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:29.602688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:29.604183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:29.607544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 305/604] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:29.608455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.622891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 300/605] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:29.623765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.678798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:29.721176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab662e4-5228-4c50-ab07-73ebc1feaf36 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:29.736127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c7d34-b053-4c47-99cd-004aefa40456 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:29.746119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:29.757689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f147e0-6467-4199-a44d-0afae7e51da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:29.758898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f147e0-6467-4199-a44d-0afae7e51da8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.761001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f147e0-6467-4199-a44d-0afae7e51da8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.761303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f147e0-6467-4199-a44d-0afae7e51da8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.774650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f147e0-6467-4199-a44d-0afae7e51da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:29.779834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402ff5a-3259-446a-8695-fe8ee7ee2977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-74f147e0-6467-4199-a44d-0afae7e51da8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:29.780681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:29.781768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:29.782767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:29.783616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ff5a-3259-446a-8695-fe8ee7ee2977 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:29.784044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ff5a-3259-446a-8695-fe8ee7ee2977 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:29.784444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ff5a-3259-446a-8695-fe8ee7ee2977 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/bde6248cf0794fab88a093097b597c9a/roles/a30240f5fb7d4b76a899eaed2f4cf878` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:29.784549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 306/606] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:29.785525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f147e0-6467-4199-a44d-0afae7e51da8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.802604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402ff5a-3259-446a-8695-fe8ee7ee2977 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=bde6248cf0794fab88a093097b597c9a, role_id=a30240f5fb7d4b76a899eaed2f4cf878)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:29.804363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402ff5a-3259-446a-8695-fe8ee7ee2977 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:29.828329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 301/607] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:39:29 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/bde6248cf0794fab88a093097b597c9a/roles/a30240f5fb7d4b76a899eaed2f4cf878 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:29.828329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402ff5a-3259-446a-8695-fe8ee7ee2977 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:29.952987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f147e0-6467-4199-a44d-0afae7e51da8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.022189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.023116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.023473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.023850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.032543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:30.034170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:30.045161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:30.049506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402ff5a-3259-446a-8695-fe8ee7ee2977 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:30.051183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:30.052049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:30.052956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 307/608] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:30.058956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:30.097676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.099614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.100106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.100600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.101519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:30.102038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:30.104199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:30.115316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:30.118768 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 302/609] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:30.123758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:30.184668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1dc01-5ce4-4067-97d4-60f983cd46c5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.232020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e882c74-d92b-4980-a421-e69cbc81beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.233334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882c74-d92b-4980-a421-e69cbc81beb9 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.234060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882c74-d92b-4980-a421-e69cbc81beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.234697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e882c74-d92b-4980-a421-e69cbc81beb9 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.236327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e882c74-d92b-4980-a421-e69cbc81beb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:30.236818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e882c74-d92b-4980-a421-e69cbc81beb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:30.238946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e882c74-d92b-4980-a421-e69cbc81beb9 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:30.242039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59debf-270a-4216-ba8b-5b77d3d0ef55 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.256033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 308/610] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:30.257579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c70ffa-63b7-48c6-8756-35b120553e34 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.258026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c70ffa-63b7-48c6-8756-35b120553e34 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.259018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c70ffa-63b7-48c6-8756-35b120553e34 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.260757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 309/611] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:30.262829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c70ffa-63b7-48c6-8756-35b120553e34 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:30.292029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f836a-f422-4377-a2b6-0650d3dae473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.293045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f836a-f422-4377-a2b6-0650d3dae473 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.293527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f836a-f422-4377-a2b6-0650d3dae473 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.294000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f836a-f422-4377-a2b6-0650d3dae473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.305890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f836a-f422-4377-a2b6-0650d3dae473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:30.307789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f836a-f422-4377-a2b6-0650d3dae473 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-e01f836a-f422-4377-a2b6-0650d3dae473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:30.323868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:30.324812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:30.325721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:30.325721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:30.325721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:30.325721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:30.327986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 303/612] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:30.329451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79f34-a703-4ea9-9fb3-5d4a3f22fe5f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.330133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79f34-a703-4ea9-9fb3-5d4a3f22fe5f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.330641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79f34-a703-4ea9-9fb3-5d4a3f22fe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.349771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-acd79f34-a703-4ea9-9fb3-5d4a3f22fe5f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:30.351325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-acd79f34-a703-4ea9-9fb3-5d4a3f22fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:30.362355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:30.384994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c70ffa-63b7-48c6-8756-35b120553e34 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.388551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:30.425287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128a70f-64fc-42ef-9311-4da442c8ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.426370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128a70f-64fc-42ef-9311-4da442c8ceb1 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.426881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128a70f-64fc-42ef-9311-4da442c8ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.427381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128a70f-64fc-42ef-9311-4da442c8ceb1 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/77a234b8e5f2472cb3e733f933ca1f4e/roles/a30240f5fb7d4b76a899eaed2f4cf878` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.443586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128a70f-64fc-42ef-9311-4da442c8ceb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=77a234b8e5f2472cb3e733f933ca1f4e, role_id=a30240f5fb7d4b76a899eaed2f4cf878)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:30.445802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 304/613] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:30.446829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128a70f-64fc-42ef-9311-4da442c8ceb1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:30.447333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79f34-a703-4ea9-9fb3-5d4a3f22fe5f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:30.471292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 310/614] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:39:30 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/77a234b8e5f2472cb3e733f933ca1f4e/roles/a30240f5fb7d4b76a899eaed2f4cf878 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:30.480158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128a70f-64fc-42ef-9311-4da442c8ceb1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:30.576285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79f34-a703-4ea9-9fb3-5d4a3f22fe5f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.611960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128a70f-64fc-42ef-9311-4da442c8ceb1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.616016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.616452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.616828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.617170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.618494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:30.618864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:30.620374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:30.634904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 305/615] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:30.640595 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:30.643692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:30.657015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5f468-376e-482d-8893-9202aaf1aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.658030 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5f468-376e-482d-8893-9202aaf1aa1a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.658538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5f468-376e-482d-8893-9202aaf1aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.659150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5f468-376e-482d-8893-9202aaf1aa1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.673238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5f468-376e-482d-8893-9202aaf1aa1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-86d5f468-376e-482d-8893-9202aaf1aa1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:30.679120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:30.680012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:30.681406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:30.683794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 311/616] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:30.691950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5f468-376e-482d-8893-9202aaf1aa1a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:30.710037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:30.765494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41660f-fd1a-4ca5-85cf-5ebda546de9d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.815933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.816583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.816867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.817138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.826000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5f468-376e-482d-8893-9202aaf1aa1a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:30.836914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:30.838332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:30.866086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:30.867110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:30.868692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:30.872593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 306/617] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:39:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:30.873429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:30.894218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:30.895185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:30.895506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:30.895778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:30.896550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:30.896863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:30.900661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:30.923361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 312/618] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:30.928444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:31.018099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:31.021295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:31.047361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902be85-ae09-480b-85e1-b3b06ec147c5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:31.094017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:31.094590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.094873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.095177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.105489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da705a4a-29ea-412b-8e34-9c8434ed0d5d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:31.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:31.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:31.139644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:31.140762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:31.141988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:31.141988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:31.141988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:31.141988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:31.150551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 313/619] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:31.156156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:31.179889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:31.181375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.181803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.182250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.183243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:31.185821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:31.188188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:31.230002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 307/620] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:39:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:31.239914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:31.328363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05221bd0-a229-4a49-9f96-12c239c0dbc0 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:31.358557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:31.368563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fbdb4-6ada-4b36-950b-3fe817a31139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:31.369833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fbdb4-6ada-4b36-950b-3fe817a31139 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.370276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fbdb4-6ada-4b36-950b-3fe817a31139 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.370984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fbdb4-6ada-4b36-950b-3fe817a31139 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.371857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fbdb4-6ada-4b36-950b-3fe817a31139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:31.372442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fbdb4-6ada-4b36-950b-3fe817a31139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:31.374574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fbdb4-6ada-4b36-950b-3fe817a31139 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:31.382695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94489ddf-37f1-4d58-a477-3ca096a81859 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:31.390188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 314/621] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:31.391882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ac672-d911-4059-a33e-6f10908804b9 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.392305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ac672-d911-4059-a33e-6f10908804b9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.392733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ac672-d911-4059-a33e-6f10908804b9 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.398905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 315/622] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:31.400378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ac672-d911-4059-a33e-6f10908804b9 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:31.414732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:31.433922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918b91a-f6bc-4d16-a08c-f3cb0118841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:31.434795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918b91a-f6bc-4d16-a08c-f3cb0118841a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.435320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918b91a-f6bc-4d16-a08c-f3cb0118841a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.435662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918b91a-f6bc-4d16-a08c-f3cb0118841a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.520676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918b91a-f6bc-4d16-a08c-f3cb0118841a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:31.522776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918b91a-f6bc-4d16-a08c-f3cb0118841a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:31.524467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ac672-d911-4059-a33e-6f10908804b9 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:31.562170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d54a14-88e6-437b-8eb6-4409d16d68d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:31.562902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54a14-88e6-437b-8eb6-4409d16d68d7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.563282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54a14-88e6-437b-8eb6-4409d16d68d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.563622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d54a14-88e6-437b-8eb6-4409d16d68d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.571290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d54a14-88e6-437b-8eb6-4409d16d68d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:31.572950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d54a14-88e6-437b-8eb6-4409d16d68d7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-64d54a14-88e6-437b-8eb6-4409d16d68d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:31.585973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:31.587700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:31.588888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:31.594432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 316/623] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:31.595921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141933a-3983-457e-98f3-3b3dd2b811f2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.596277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141933a-3983-457e-98f3-3b3dd2b811f2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.596615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141933a-3983-457e-98f3-3b3dd2b811f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.616363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f141933a-3983-457e-98f3-3b3dd2b811f2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:31.617556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f141933a-3983-457e-98f3-3b3dd2b811f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:31.636420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 308/624] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:31.637664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918b91a-f6bc-4d16-a08c-f3cb0118841a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:31.665599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:31.672794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:31.701861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 317/625] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:31.702951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141933a-3983-457e-98f3-3b3dd2b811f2 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:31.792702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918b91a-f6bc-4d16-a08c-f3cb0118841a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:31.831407 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141933a-3983-457e-98f3-3b3dd2b811f2 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:31.847495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:31.848120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.848528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.848911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.850371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:31.850822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:31.853211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:31.875831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 309/626] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jul 26 07:39:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:31.880806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:31.885450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:31.886100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:31.886382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:31.887591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:31.901839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:31.903609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:31.923832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:31.924751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:31.925632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:31.925632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:31.925632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:31.925632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:31.925632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 318/627] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:31.930647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:31.967180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:31.975182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:32.000375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b548c02-b017-4118-aff1-379528175d28 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.038526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3364b31-06c4-4f7b-af1e-60123ff81fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.039524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364b31-06c4-4f7b-af1e-60123ff81fae None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.040058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364b31-06c4-4f7b-af1e-60123ff81fae None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.040755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364b31-06c4-4f7b-af1e-60123ff81fae None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.052210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3364b31-06c4-4f7b-af1e-60123ff81fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-b3364b31-06c4-4f7b-af1e-60123ff81fae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:32.058352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:32.059313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:32.060144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:32.060770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6da2e-f16d-46ed-b529-9d7daec891d8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.062976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 310/628] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:32.064032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3364b31-06c4-4f7b-af1e-60123ff81fae None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.110316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.110997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.111290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.111570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.127170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.128849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:32.149427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:32.150366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:32.151256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:32.151256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:32.151256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:32.151256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:32.155020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 319/629] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:32.156039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.193405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3364b31-06c4-4f7b-af1e-60123ff81fae None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.228101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.228721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.229002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.229275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.229967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:32.230266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.231661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.238156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:32.243327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:32.244886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 311/630] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:32.245899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.268332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ec710-0a35-4738-9cc1-b95ca26b573e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.302133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaea05a-f1a8-4711-bb87-3812c61f7ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.302773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea05a-f1a8-4711-bb87-3812c61f7ae0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.303061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea05a-f1a8-4711-bb87-3812c61f7ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.303337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea05a-f1a8-4711-bb87-3812c61f7ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.304050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaea05a-f1a8-4711-bb87-3812c61f7ae0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:32.304357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaea05a-f1a8-4711-bb87-3812c61f7ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.306241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaea05a-f1a8-4711-bb87-3812c61f7ae0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.314748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 320/631] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:32.315792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b071b-144b-403c-aa54-83a3249d20d1 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.316079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b071b-144b-403c-aa54-83a3249d20d1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.316357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b071b-144b-403c-aa54-83a3249d20d1 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.319044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 321/632] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:32.319044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b071b-144b-403c-aa54-83a3249d20d1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.357568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076962cc-67ad-4ee2-aab1-4127e5e080b5 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.398415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.399602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.399889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.400160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.400851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:32.401600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.403407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.416637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 312/633] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:32.421694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.424586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b071b-144b-403c-aa54-83a3249d20d1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.465683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdcbb5-836c-471a-9110-5a7e6beedc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.466325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdcbb5-836c-471a-9110-5a7e6beedc61 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.466604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdcbb5-836c-471a-9110-5a7e6beedc61 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.466877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdcbb5-836c-471a-9110-5a7e6beedc61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.473808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdcbb5-836c-471a-9110-5a7e6beedc61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.475284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdcbb5-836c-471a-9110-5a7e6beedc61 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.485341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-92fdcbb5-836c-471a-9110-5a7e6beedc61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:32.487061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:32.487969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 322/634] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:32.489556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00e6c-bc98-442e-8558-bd68d2d3a99b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.490130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00e6c-bc98-442e-8558-bd68d2d3a99b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.490130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00e6c-bc98-442e-8558-bd68d2d3a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.497659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:32.512338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-39f00e6c-bc98-442e-8558-bd68d2d3a99b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:32.513570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-39f00e6c-bc98-442e-8558-bd68d2d3a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:32.537156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f181bea-b5e5-402c-9d15-cef0d8bebf16 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.577294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.577926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.578206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.578479 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.590957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 323/635] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:32.590957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f00e6c-bc98-442e-8558-bd68d2d3a99b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.597638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.599359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:32.615696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:32.616779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:32.618398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:32.618398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:32.618398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:32.618398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:32.621745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 313/636] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:32.622569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.694985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f00e6c-bc98-442e-8558-bd68d2d3a99b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.723280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e27b7-48e2-4399-a92a-5a7bb5fdadd1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.727927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.728567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.728849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.729125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.731013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:32.734245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:32.736816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.738495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:32.750412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:32.751467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 324/637] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:32.752387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.761564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.762183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.762461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.762739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.763525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:32.763835 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.765258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.777208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 314/638] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:32.777981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.856017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6ba6-1603-4a94-8471-fb850b729d6c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.876936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addccba-299f-4dab-8d53-948e36d66763 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:32.888601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc27b-ee3f-4cd3-9d67-d4db171d200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.889295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc27b-ee3f-4cd3-9d67-d4db171d200d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.889581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc27b-ee3f-4cd3-9d67-d4db171d200d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.889856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc27b-ee3f-4cd3-9d67-d4db171d200d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.900833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dc27b-ee3f-4cd3-9d67-d4db171d200d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-d54dc27b-ee3f-4cd3-9d67-d4db171d200d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:32.906173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:32.907308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:32.908196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 325/639] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:32.908897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3c6e0-863a-4fb6-b633-b1be7ce5396f None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.908897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3c6e0-863a-4fb6-b633-b1be7ce5396f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.909034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3c6e0-863a-4fb6-b633-b1be7ce5396f None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.914303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 326/640] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:32.914303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3c6e0-863a-4fb6-b633-b1be7ce5396f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.916778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:32.917620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:32.918740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:32.919049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:32.919752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:32.920061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:32.921420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:32.932743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 315/641] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:32.933516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:32.964702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:32.970090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:33.015313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3c6e0-863a-4fb6-b633-b1be7ce5396f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.033087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43db076-317d-485c-bd24-62181d6d5ba7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.049001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.049619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.049897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.050173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.050918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:33.051251 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.052677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.064316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 327/642] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:33.066476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1caa380-120f-4289-b56d-200a5bb14024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.067199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa380-120f-4289-b56d-200a5bb14024 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.067538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa380-120f-4289-b56d-200a5bb14024 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.067884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa380-120f-4289-b56d-200a5bb14024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.067972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.068795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caa380-120f-4289-b56d-200a5bb14024 None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=867e92c5301945a88e5c0ed06c4b7257) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:33.069373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caa380-120f-4289-b56d-200a5bb14024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.070692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caa380-120f-4289-b56d-200a5bb14024 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.076476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 316/643] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:32 2022] GET /identity/v3/role_assignments?user.id=867e92c5301945a88e5c0ed06c4b7257&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:33.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18361216-b28d-44df-b72b-bd77664f36a6 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.077912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18361216-b28d-44df-b72b-bd77664f36a6 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.078192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18361216-b28d-44df-b72b-bd77664f36a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.098646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-18361216-b28d-44df-b72b-bd77664f36a6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:33.099937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-18361216-b28d-44df-b72b-bd77664f36a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:33.179506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 317/644] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:33.180195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18361216-b28d-44df-b72b-bd77664f36a6 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.181683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffb1f-6638-47b5-82ee-c31945a4636f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.207985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:33.210310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:33.234658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.235252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.235540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.235879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.236603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:33.236965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.238366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.248464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 328/645] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:33.249383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.299559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18361216-b28d-44df-b72b-bd77664f36a6 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.340197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.341235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.341622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.342039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.350520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.352004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:33.363890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:33.364958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:39:33.365950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:33.366498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed518986-c4c7-47e8-88aa-2066d8db870e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.366571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 318/646] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:33.366571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.399929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd2f20-76ab-4403-a389-f3a3a64bf690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.400609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd2f20-76ab-4403-a389-f3a3a64bf690 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.400897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd2f20-76ab-4403-a389-f3a3a64bf690 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.401170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd2f20-76ab-4403-a389-f3a3a64bf690 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/de1dd35abd2e4db0bda795191eeee287/roles/a30240f5fb7d4b76a899eaed2f4cf878` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.415625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd2f20-76ab-4403-a389-f3a3a64bf690 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=de1dd35abd2e4db0bda795191eeee287, role_id=a30240f5fb7d4b76a899eaed2f4cf878)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.417068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd2f20-76ab-4403-a389-f3a3a64bf690 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.432127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 329/647] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:39:33 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/de1dd35abd2e4db0bda795191eeee287/roles/a30240f5fb7d4b76a899eaed2f4cf878 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:33.433046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd2f20-76ab-4403-a389-f3a3a64bf690 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.468997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:33.481189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:33.493038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc6fb8-dad1-49e6-9486-33cf6933470a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.535885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde410-4029-421c-902f-578bd2aa88cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.536919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde410-4029-421c-902f-578bd2aa88cd None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.537406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde410-4029-421c-902f-578bd2aa88cd None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.538325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde410-4029-421c-902f-578bd2aa88cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.552273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cde410-4029-421c-902f-578bd2aa88cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-75cde410-4029-421c-902f-578bd2aa88cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:33.559396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:33.560379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:33.561218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:33.564114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 319/648] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:33.565335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde410-4029-421c-902f-578bd2aa88cd None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.594185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd2f20-76ab-4403-a389-f3a3a64bf690 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.635402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.636406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.636932 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.637434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.651478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.653503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:33.669950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:33.671097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:33.671976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:33.671976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:33.671976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:33.671976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:33.673817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 330/649] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:33.674851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.695325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde410-4029-421c-902f-578bd2aa88cd None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.741290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.742162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.742613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.743574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.744732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:33.745136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.747330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.766901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 320/650] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:33.767612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:33.768329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.771982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:33.794021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b57c20-1411-437d-b374-c460406b96b1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.831169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.831913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.832198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.832472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.833300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:33.833614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.835017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.855631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 331/651] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:33.855631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:33.906639 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab0b83-3114-4713-a67a-99789af7b5cb None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.957371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:33.958660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:33.959587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:33.960353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:33.961567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:33.962474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:33.964374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:33.965039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b91e-81b0-44f0-b7f6-0511636dcf58 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:33.981304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 321/652] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:33.982535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.006779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8436-7296-41f0-9c50-dcbf812e871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.007400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8436-7296-41f0-9c50-dcbf812e871c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.007685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8436-7296-41f0-9c50-dcbf812e871c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.007962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8436-7296-41f0-9c50-dcbf812e871c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.019625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:34.066780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:34.095987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8436-7296-41f0-9c50-dcbf812e871c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.098245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8436-7296-41f0-9c50-dcbf812e871c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.108076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc1baf-d16c-4a84-85dc-abd0ca8f2eb4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:34.145715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.146457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.146817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.147351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.161537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.163875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:34.184871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:34.185833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:34.186718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:34.186718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:34.186718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:34.186718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:34.191366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 322/653] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:34.192217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.236139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 332/654] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:34.237307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8436-7296-41f0-9c50-dcbf812e871c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.283209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:34.310081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23b45c-eeb6-4797-ac5b-8f2df8acecc9 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:34.324241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:34.346871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.347547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.347834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.348113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] PATH_INFO: `/v3/users/glance` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.348757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8436-7296-41f0-9c50-dcbf812e871c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:34.358473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.360349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:34.374776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:34.375919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 07:39:34.377095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:34.378061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 323/655] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:34.378519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.389327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.390252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.390739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.391246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.392209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:34.392736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.394755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.407635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 333/656] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:34.408756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.507083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f64e-e31c-4c9f-b677-afd29e3a8d6e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:34.511594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:34.515475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523fdd-c78f-4e29-b0ab-a0d421e42d55 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:34.551800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.552430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.552663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.552940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.555001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.555915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.556428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.556920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.557964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:34.558477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.560173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.565266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.566777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.582534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 334/657] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:34.583791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:34.589642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:34.590540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:34.591858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:34.591858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:34.591858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:34.591858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:34.591858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 324/658] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:34.591858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.627958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:34.706054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3f3e5-693f-4d52-95fe-5302058e0827 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:34.717417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e470024-338f-43c1-8fab-8e9e04a5ae9d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:34.742093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f4cb4-5e09-4164-b0ba-18f481645ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.743152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f4cb4-5e09-4164-b0ba-18f481645ea7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.743642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f4cb4-5e09-4164-b0ba-18f481645ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.744122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f4cb4-5e09-4164-b0ba-18f481645ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.760223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.760871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.761153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.761787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.770815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.772873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:34.788501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:34.789484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 335/659] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:34.791276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.814413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:34.829938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f4cb4-5e09-4164-b0ba-18f481645ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.831735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f4cb4-5e09-4164-b0ba-18f481645ea7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.864876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:34.921623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475cb07-4f7c-4f51-bb83-dda7597d8851 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:34.959144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:34.960684 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:34.961150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:34.962126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:34.963020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:34.963477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:34.964489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 325/660] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:34.965331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:34.965567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f4cb4-5e09-4164-b0ba-18f481645ea7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:34.981830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 336/661] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:34.982959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.076278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:35.100350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fd078-0f9d-4b71-9b10-8fbd9ef2dcb7 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.106720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f4cb4-5e09-4164-b0ba-18f481645ea7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.138166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.139127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.139550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.139986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.141685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:35.152334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.153557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.154235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.154355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.154724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.155145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.156049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:35.156459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.158708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:35.170823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:35.171936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:35.173046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:35.173046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:35.173046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:35.173046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:35.175016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 337/662] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:35.176060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.182630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 326/663] 10.222.0.46 () {56 vars in 1139 bytes} [Tue Jul 26 07:39:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:35.183615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.290650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13bfb7-d064-4535-b1d1-9af4fe700abb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.293811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697724c-c20b-4346-92da-155f7bbf6320 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.322233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:35.329312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.329767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d398c-12b0-473b-9a13-e8ee80d96ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.329903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.330147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.330426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.330585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d398c-12b0-473b-9a13-e8ee80d96ad5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.330836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d398c-12b0-473b-9a13-e8ee80d96ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.331143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d398c-12b0-473b-9a13-e8ee80d96ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.331239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:35.331463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.332864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.338162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d398c-12b0-473b-9a13-e8ee80d96ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.339917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d398c-12b0-473b-9a13-e8ee80d96ad5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.344877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 327/664] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:35.345683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4e6d398c-12b0-473b-9a13-e8ee80d96ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:35.352041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:35.352969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:35.354265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 338/665] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:35.354757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68314302-8e7e-4238-afd5-0dd5b9bfc4d5 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.354967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68314302-8e7e-4238-afd5-0dd5b9bfc4d5 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.355166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68314302-8e7e-4238-afd5-0dd5b9bfc4d5 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.356396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 339/666] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:35.357087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68314302-8e7e-4238-afd5-0dd5b9bfc4d5 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.402435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:35.459127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a24d-7683-4e90-ae8d-0e003f45d596 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.471197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68314302-8e7e-4238-afd5-0dd5b9bfc4d5 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.494660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8916f5-b05c-4be1-b898-b035e7d4697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.495318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8916f5-b05c-4be1-b898-b035e7d4697c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.495587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8916f5-b05c-4be1-b898-b035e7d4697c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.495862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8916f5-b05c-4be1-b898-b035e7d4697c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.508072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.508749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.509036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.509331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.515998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.517449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:35.529300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:35.530274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 340/667] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:35.531273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.567803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8916f5-b05c-4be1-b898-b035e7d4697c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.569267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8916f5-b05c-4be1-b898-b035e7d4697c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.580299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:35.612512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:35.632641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe660491-f607-4412-ae8f-0547de52d60c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.665993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0fdab-7064-4e5c-b08c-cbe54006418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.666458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 328/668] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:35.666592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fdab-7064-4e5c-b08c-cbe54006418f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.666876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fdab-7064-4e5c-b08c-cbe54006418f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.667181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fdab-7064-4e5c-b08c-cbe54006418f None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.667740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7c98-4ceb-40b0-99f7-2fe10e58caee None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.667932 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fdab-7064-4e5c-b08c-cbe54006418f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:35.668032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7c98-4ceb-40b0-99f7-2fe10e58caee None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.668243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fdab-7064-4e5c-b08c-cbe54006418f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.668322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7c98-4ceb-40b0-99f7-2fe10e58caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.669680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fdab-7064-4e5c-b08c-cbe54006418f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.682582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 341/669] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:35.683808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781850-3678-4e6b-908f-37f1562b2a28 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.684096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781850-3678-4e6b-908f-37f1562b2a28 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.684376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781850-3678-4e6b-908f-37f1562b2a28 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.687615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 342/670] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:35.687743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f93c7c98-4ceb-40b0-99f7-2fe10e58caee None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:35.687835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff781850-3678-4e6b-908f-37f1562b2a28 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.687938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f93c7c98-4ceb-40b0-99f7-2fe10e58caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:35.752427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 329/671] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:35.753285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c7c98-4ceb-40b0-99f7-2fe10e58caee None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.788747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff781850-3678-4e6b-908f-37f1562b2a28 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.799815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:35.823417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.824033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.824316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.824591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.825334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:35.825643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.827095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.835968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:35.842976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 343/672] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:35.842976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:35.868694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c7c98-4ceb-40b0-99f7-2fe10e58caee None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.902044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2f55c-1ac8-4c40-8e9e-6a86d02018d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.902689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f55c-1ac8-4c40-8e9e-6a86d02018d0 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.902998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f55c-1ac8-4c40-8e9e-6a86d02018d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.903274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f55c-1ac8-4c40-8e9e-6a86d02018d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.913065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2f55c-1ac8-4c40-8e9e-6a86d02018d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.914584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2f55c-1ac8-4c40-8e9e-6a86d02018d0 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-9dc2f55c-1ac8-4c40-8e9e-6a86d02018d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:35.929351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:35.930421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:35.931401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:35.931401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:35.931401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:35.931401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:35.931401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 330/673] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:35.931694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed9a0-2922-475b-b2f9-668c87a79b3b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.931942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed9a0-2922-475b-b2f9-668c87a79b3b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.932216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed9a0-2922-475b-b2f9-668c87a79b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.947104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0d88b-3aac-4021-83d0-0f5ea3123b00 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:35.949801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-53aed9a0-2922-475b-b2f9-668c87a79b3b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:35.951085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-53aed9a0-2922-475b-b2f9-668c87a79b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:35.981151 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:35.981763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:35.982042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:35.982312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:35.983124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=c1886d36711f4ca48191ebfbee3e9a0f) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:35.983429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:35.984926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:35.990570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 344/674] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/role_assignments?user.id=c1886d36711f4ca48191ebfbee3e9a0f&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:35.991355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.019797 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 331/675] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:36.020940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aed9a0-2922-475b-b2f9-668c87a79b3b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.028564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:36.084442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:36.109460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cb828-3fb6-4b04-8c4e-47ac59b2889a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.134314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aed9a0-2922-475b-b2f9-668c87a79b3b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.147055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1c4f0-8412-4418-9c18-c905fa7577c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.147717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1c4f0-8412-4418-9c18-c905fa7577c5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.148004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1c4f0-8412-4418-9c18-c905fa7577c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.148283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1c4f0-8412-4418-9c18-c905fa7577c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.162088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1c4f0-8412-4418-9c18-c905fa7577c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-2eb1c4f0-8412-4418-9c18-c905fa7577c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:36.168692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:36.169617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:36.170480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 345/676] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:36.174970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1c4f0-8412-4418-9c18-c905fa7577c5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.178489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.179151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.179832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.180150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.180969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=bde6248cf0794fab88a093097b597c9a) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:36.181289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:36.182738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:36.189336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 332/677] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/role_assignments?user.id=bde6248cf0794fab88a093097b597c9a&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:36.190122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.298253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:36.306735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1c4f0-8412-4418-9c18-c905fa7577c5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.339238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b12e06-c418-46f7-8334-07109dcf1ff6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.349194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.350468 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.351482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.351482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.351776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:36.352452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:36.354138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:36.365894 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:36.368667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 346/678] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:36.369527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.387333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3956c34-82ae-49e3-9b3b-5f6bc906cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.388199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3956c34-82ae-49e3-9b3b-5f6bc906cacb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.388497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3956c34-82ae-49e3-9b3b-5f6bc906cacb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.388784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3956c34-82ae-49e3-9b3b-5f6bc906cacb None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.406501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3956c34-82ae-49e3-9b3b-5f6bc906cacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-a3956c34-82ae-49e3-9b3b-5f6bc906cacb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:36.413078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:36.414028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:36.415292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 333/679] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:36.420170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3956c34-82ae-49e3-9b3b-5f6bc906cacb None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.506078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c370-eb21-4523-bacc-4e88e1730aa5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.549384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3956c34-82ae-49e3-9b3b-5f6bc906cacb None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.560832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.561873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.562430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.562720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.563485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:36.563795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:36.566051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:36.579262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 347/680] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:36.580171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.596098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.597482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.598022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.598522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.602773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:36.607323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:36.609836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:36.624033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:36.624981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:36.625881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:36.625881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:36.625881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:36.625881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:36.625881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:36.625881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:36.625881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:36.625881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:36.628505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 334/681] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:36.629736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.698339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:36.708799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e11c24-777d-4ccb-bab1-507be021eb09 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.749371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.750843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.751414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.751903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.752881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:36.753413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:36.755035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:36.764982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 348/682] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:36.766297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.784964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39205d6e-04fa-4d82-ae25-2f7813eaaf10 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.840995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.844393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.844942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.845425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.862814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:36.864606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:36.868617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:36.882563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:36.884145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:36.885108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:36.885108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:36.885108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:36.885108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:36.891805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 335/683] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:36.892839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d18fd5-da43-4e3f-a21f-02716ba8d074 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:36.893155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:36.937969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:36.938631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:36.938913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:36.939351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:36.940109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:36.940422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:36.942298 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:36.958749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 349/684] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:36.959776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.000684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:37.011892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa584-e7c4-4049-b742-379fe4a9163a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.050094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.051150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.051706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.052298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.065027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.066766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.068000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18190-d4dc-4518-bf4d-15340e223524 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:37.082887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:37.083843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:37.084738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:37.084738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:37.084738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:37.084738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:37.087098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 336/685] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:37.088120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.108344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.109001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.109281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.109555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.110244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:37.110550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.112068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.119562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:37.129380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 350/686] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:37.129380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.215240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd95b3-e142-4588-a273-33e8cf356919 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.233764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34fe5-9c26-47c2-aafe-ee50cd4151ba None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.257332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.257932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.258453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.259501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=77a234b8e5f2472cb3e733f933ca1f4e) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:37.260038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.261817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.268954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.269833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.270251 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.270372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.270589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 337/687] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:37 2022] GET /identity/v3/role_assignments?user.id=77a234b8e5f2472cb3e733f933ca1f4e&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:37.271122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:37.271432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.272143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.272802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.284936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:37.286382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 351/688] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:37.292470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.356136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:37.395119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cd030-ccb1-4b0e-8fc9-024385a7018b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.401808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b268af-b4c0-4b92-9041-edfe0341024f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.437193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.438586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.439251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.439729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.439866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.440647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.441004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.441364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.449634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.450388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.451314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.452492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:37.465523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:37.466540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:37.467956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:37.469104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:37.469983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:37.471005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:37.471997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 352/689] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:37.472948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.478879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 338/690] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:39:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:37.480410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.579449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:37.619626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0db31-d363-4982-9bb6-84542c6eb240 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.659174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.660168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.660611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.661038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.662012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:37.662573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.664408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.687347 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 339/691] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:39:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:37.690012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.702862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf35c-75df-4043-9d76-5216c713b3d6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.721058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:37.740003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.740648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.741021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.741373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.742298 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:37.742662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.744696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.769640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 353/692] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jul 26 07:39:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:37.770619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:37.809431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66bd33-fb73-405a-826a-3172709826dd None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.848664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e09f-e8bd-407e-b9a7-d6d04dc5e496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.849537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e09f-e8bd-407e-b9a7-d6d04dc5e496 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.850136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e09f-e8bd-407e-b9a7-d6d04dc5e496 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.850634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e09f-e8bd-407e-b9a7-d6d04dc5e496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:37.855351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:37.889544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894517-b957-4ab5-ae92-ed8e1479cbea None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:37.939965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7e09f-e8bd-407e-b9a7-d6d04dc5e496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:37.941816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7e09f-e8bd-407e-b9a7-d6d04dc5e496 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:37.943039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27d10b-058b-49b4-8027-9eae8a8d3b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:37.943687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27d10b-058b-49b4-8027-9eae8a8d3b4a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:37.943974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27d10b-058b-49b4-8027-9eae8a8d3b4a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:37.944255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27d10b-058b-49b4-8027-9eae8a8d3b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.036396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:38.067410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 340/693] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 07:39:38.069929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e09f-e8bd-407e-b9a7-d6d04dc5e496 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:38.095500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27d10b-058b-49b4-8027-9eae8a8d3b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:38.096970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27d10b-058b-49b4-8027-9eae8a8d3b4a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:38.102201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:38.184592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e09f-e8bd-407e-b9a7-d6d04dc5e496 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:38.223155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:38.224120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.224641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.225024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.236934 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:38.238809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:38.256421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:38.257511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:38.259329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:38.259329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:38.259329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:38.259329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:38.265581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 341/694] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:38.266880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:38.335563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 354/695] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 07:39:38.341373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0f6b-350e-4214-8a1b-4f7a52c24367 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.342011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0f6b-350e-4214-8a1b-4f7a52c24367 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.342452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff0f6b-350e-4214-8a1b-4f7a52c24367 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.344245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 355/696] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:38.345218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0f6b-350e-4214-8a1b-4f7a52c24367 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:38.387360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:38.399487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462f27-6338-4c09-91e1-e35c353a3b6b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:38.437712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:38.442241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b89d61-13a7-476f-acca-8d5e42a127fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:38.443366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b89d61-13a7-476f-acca-8d5e42a127fb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.444168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b89d61-13a7-476f-acca-8d5e42a127fb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.445020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b89d61-13a7-476f-acca-8d5e42a127fb None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.446685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b89d61-13a7-476f-acca-8d5e42a127fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:38.447152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b89d61-13a7-476f-acca-8d5e42a127fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:38.448942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b89d61-13a7-476f-acca-8d5e42a127fb None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:38.465973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff0f6b-350e-4214-8a1b-4f7a52c24367 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:38.470211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 342/697] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:38.472585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d0545-9623-4a9c-a06d-abcdd2fab73c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.472880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d0545-9623-4a9c-a06d-abcdd2fab73c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.473160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d0545-9623-4a9c-a06d-abcdd2fab73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.494359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-151d0545-9623-4a9c-a06d-abcdd2fab73c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:38.495702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-151d0545-9623-4a9c-a06d-abcdd2fab73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:38.508091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:38.509149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.509707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.510230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.522382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:38.524227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:38.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:38.541837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:38.542727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:38.542727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:38.542727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:38.542727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:38.549297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 356/698] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:38.550471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:38.571297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 343/699] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:38.572240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d0545-9623-4a9c-a06d-abcdd2fab73c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:38.641030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:38.662621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6abebe-369e-4ba3-bb81-18ba855b369d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:38.675447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d0545-9623-4a9c-a06d-abcdd2fab73c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:38.689347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:38.698466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73e8bf-7476-4901-8f82-b8e038949a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:38.699219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73e8bf-7476-4901-8f82-b8e038949a6e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.699509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73e8bf-7476-4901-8f82-b8e038949a6e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.699788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73e8bf-7476-4901-8f82-b8e038949a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.706477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73e8bf-7476-4901-8f82-b8e038949a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:38.707950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73e8bf-7476-4901-8f82-b8e038949a6e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:38.711412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa593b-db80-4fa9-81db-44cc3726e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:38.712255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa593b-db80-4fa9-81db-44cc3726e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.712726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa593b-db80-4fa9-81db-44cc3726e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.713213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa593b-db80-4fa9-81db-44cc3726e5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.714088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa593b-db80-4fa9-81db-44cc3726e5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:38.714575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa593b-db80-4fa9-81db-44cc3726e5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:38.716175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa593b-db80-4fa9-81db-44cc3726e5c7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-3d73e8bf-7476-4901-8f82-b8e038949a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:38.719433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:38.720341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:38.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 357/700] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:38.721798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e84b-75b4-40f8-bbe6-c5b3ebfdf99d None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.722177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e84b-75b4-40f8-bbe6-c5b3ebfdf99d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.722360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e84b-75b4-40f8-bbe6-c5b3ebfdf99d None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.723944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 358/701] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:38.724724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29e84b-75b4-40f8-bbe6-c5b3ebfdf99d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:38.738417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 344/702] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:38.738417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb73cc-d2c9-4a07-9888-181e1348ddb7 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.738417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb73cc-d2c9-4a07-9888-181e1348ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.738417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb73cc-d2c9-4a07-9888-181e1348ddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.755430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b4cb73cc-d2c9-4a07-9888-181e1348ddb7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:38.756621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b4cb73cc-d2c9-4a07-9888-181e1348ddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:38.829058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 345/703] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:38.830062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb73cc-d2c9-4a07-9888-181e1348ddb7 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:38.851661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29e84b-75b4-40f8-bbe6-c5b3ebfdf99d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:38.889056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:38.889700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.890242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.890242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.890844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:38.892337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:38.904152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:38.905171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:38.906044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 359/704] 10.222.0.46 () {56 vars in 1129 bytes} [Tue Jul 26 07:39:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:38.906912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:38.908158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:38.956076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb73cc-d2c9-4a07-9888-181e1348ddb7 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:38.962278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:38.991471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:38.992093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:38.992377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:38.992689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:38.993442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:38.993750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:38.995205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.006734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 346/705] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:39.007783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.017202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1d7c9-5044-417a-98fe-41031c038860 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.054200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.054844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.055235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.055500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.062233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.063965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:39.075270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:39.076157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:39.077047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 360/706] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:39.077530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.116901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d672-3ea3-49b7-9e9f-f29b0ae60eb4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.133754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:39.154254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.154897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.155204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.155480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.168192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.169915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.182666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bee79-511b-445e-bac5-0eed954bad17 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:39.186070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:39.186993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:39.187962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:39.187962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:39.187962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:39.187962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:39.193627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 347/707] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:39.193627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.195299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:39.218670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.219487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.219697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.219964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.220756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:39.221063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.222527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.231750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 361/708] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:39.231750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.297771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511a61c-c2e6-48da-897b-c913adc1eadf None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.332237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.332857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.333140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.333420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.334217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=867e92c5301945a88e5c0ed06c4b7257) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:39.334535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.336012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.340273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2779-012b-4f92-8bf6-f500588be118 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.342070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 348/709] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/role_assignments?user.id=867e92c5301945a88e5c0ed06c4b7257&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=53894f3146884908ba6dd3e118397fb3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:39.342875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.386556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.387537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.387978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.388403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.389296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:39.389821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:39.390580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.392302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.407877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 362/710] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:39.409005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.448745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:39.537111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1255fe-7c9f-4151-b3e4-0f03efe914f3 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.577089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.577721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.578003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.578276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.579118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:39.579427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.580907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.588131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 363/711] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:39.589030 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.604139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860ced1-fcdf-490d-b816-9659a5ca2d12 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.641807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.642543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.642946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.643270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.644046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:39.644779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.646342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.660328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 349/712] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:39.666623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.703722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:39.707494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9db85e-175e-46b0-94f9-4ddc3848ddcb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.749005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0fd59-7c14-4d0c-876f-2c51da3f0bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.749646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fd59-7c14-4d0c-876f-2c51da3f0bec None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.749928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fd59-7c14-4d0c-876f-2c51da3f0bec None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.750200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fd59-7c14-4d0c-876f-2c51da3f0bec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.751044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0fd59-7c14-4d0c-876f-2c51da3f0bec None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=de1dd35abd2e4db0bda795191eeee287) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:39.751357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0fd59-7c14-4d0c-876f-2c51da3f0bec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.752846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0fd59-7c14-4d0c-876f-2c51da3f0bec None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.759938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 364/713] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/role_assignments?user.id=de1dd35abd2e4db0bda795191eeee287&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:39.761214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88ad7-2d44-4a0a-91df-395d19ed0268 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.761502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88ad7-2d44-4a0a-91df-395d19ed0268 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.761774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88ad7-2d44-4a0a-91df-395d19ed0268 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.763079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 365/714] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:39.768634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030d20-b88b-49c1-8290-9084406f5de3 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.768922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030d20-b88b-49c1-8290-9084406f5de3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.769450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030d20-b88b-49c1-8290-9084406f5de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.796334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-38030d20-b88b-49c1-8290-9084406f5de3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:39.797602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-38030d20-b88b-49c1-8290-9084406f5de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:39.853429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:39.888987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd99ac-c266-4603-b9da-485d57da9526 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:39.905377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 366/715] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:39.927336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38030d20-b88b-49c1-8290-9084406f5de3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:39.941111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8644c6-03db-4bb8-b588-9c36d2f44db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:39.941111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8644c6-03db-4bb8-b588-9c36d2f44db1 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:39.941111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8644c6-03db-4bb8-b588-9c36d2f44db1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:39.941111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8644c6-03db-4bb8-b588-9c36d2f44db1 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:39.941517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8644c6-03db-4bb8-b588-9c36d2f44db1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:39.942518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8644c6-03db-4bb8-b588-9c36d2f44db1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:39.972265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 350/716] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:39:39 2022] POST /identity/v3/users => generated 254 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:39:40.045977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:40.054194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38030d20-b88b-49c1-8290-9084406f5de3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:40.096666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:40.097614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:40.098040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:40.098454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] PATH_INFO: `/v3/services/network` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:40.099369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:40.100998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:40.111207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:40.112426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:40.113484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:40.116080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 367/717] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:39 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:40.122212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8644c6-03db-4bb8-b588-9c36d2f44db1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:40.232165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8644c6-03db-4bb8-b588-9c36d2f44db1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:40.268230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54fa8a-b568-4a33-840e-f97441af4c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:40.268861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54fa8a-b568-4a33-840e-f97441af4c5d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:40.269140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54fa8a-b568-4a33-840e-f97441af4c5d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:40.269665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54fa8a-b568-4a33-840e-f97441af4c5d None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:40.270354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54fa8a-b568-4a33-840e-f97441af4c5d None admin] RBAC: Adding query filter params (name=network) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:40.270655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54fa8a-b568-4a33-840e-f97441af4c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:40.272081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54fa8a-b568-4a33-840e-f97441af4c5d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:40.277737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 351/718] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:39:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:40.283252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:40.397125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f080fca-f2e8-4854-9e6c-703118164d5d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:40.433719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c735ee-5cdb-4528-8129-d7ffe6b8221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:40.434346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c735ee-5cdb-4528-8129-d7ffe6b8221f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:40.434717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c735ee-5cdb-4528-8129-d7ffe6b8221f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:40.435035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c735ee-5cdb-4528-8129-d7ffe6b8221f None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:40.435826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c735ee-5cdb-4528-8129-d7ffe6b8221f None admin] RBAC: Adding query filter params (type=network) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:40.436137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c735ee-5cdb-4528-8129-d7ffe6b8221f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:40.437516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c735ee-5cdb-4528-8129-d7ffe6b8221f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:40.442592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 368/719] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:39:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:41.906235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5afae-79b5-4557-acd2-5bb92baad79b None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:41.907225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5afae-79b5-4557-acd2-5bb92baad79b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:41.907734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5afae-79b5-4557-acd2-5bb92baad79b None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:41.909559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 352/720] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:41.914735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371979-a6d1-41f7-af1f-ced09010375f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:41.915260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371979-a6d1-41f7-af1f-ced09010375f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:41.915415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b371979-a6d1-41f7-af1f-ced09010375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:41.943966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8b371979-a6d1-41f7-af1f-ced09010375f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:41.945178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8b371979-a6d1-41f7-af1f-ced09010375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:41.971161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:42.052330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 369/721] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:42.096502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5afae-79b5-4557-acd2-5bb92baad79b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:42.123808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:42.124112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fda4a-19ff-4ea4-b10b-50cbfe71cbcc None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.124367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fda4a-19ff-4ea4-b10b-50cbfe71cbcc None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.124649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fda4a-19ff-4ea4-b10b-50cbfe71cbcc None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.126339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 370/722] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:39:42.131967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c25ec5-8cc8-4def-84cd-3fad33467415 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.132258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c25ec5-8cc8-4def-84cd-3fad33467415 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.132765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c25ec5-8cc8-4def-84cd-3fad33467415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.175947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-d8c25ec5-8cc8-4def-84cd-3fad33467415 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:42.177153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d8c25ec5-8cc8-4def-84cd-3fad33467415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:42.267613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5afae-79b5-4557-acd2-5bb92baad79b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:42.273493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 371/723] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:42.299556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c25ec5-8cc8-4def-84cd-3fad33467415 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:42.328560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f213-3195-41e7-86d3-05432a919008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:42.329220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f213-3195-41e7-86d3-05432a919008 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.329504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f213-3195-41e7-86d3-05432a919008 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.329779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f213-3195-41e7-86d3-05432a919008 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.363842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35f213-3195-41e7-86d3-05432a919008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-5d35f213-3195-41e7-86d3-05432a919008 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:42.369469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:42.371546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:42.373489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 353/724] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:42.377590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f213-3195-41e7-86d3-05432a919008 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:42.400795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:42.446903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c25ec5-8cc8-4def-84cd-3fad33467415 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:42.477942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:42.511670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589b64-6af3-4cff-ab82-906b168e9e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:42.512304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589b64-6af3-4cff-ab82-906b168e9e4e None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.512588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589b64-6af3-4cff-ab82-906b168e9e4e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.512862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589b64-6af3-4cff-ab82-906b168e9e4e None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.513560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb589b64-6af3-4cff-ab82-906b168e9e4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:42.514961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb589b64-6af3-4cff-ab82-906b168e9e4e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:42.528616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f213-3195-41e7-86d3-05432a919008 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:42.549335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 372/725] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:39:42 2022] POST /identity/v3/services => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:39:42.552733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f63ac-93d6-4bd9-8531-7615e4c7412c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.553060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f63ac-93d6-4bd9-8531-7615e4c7412c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.553309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f63ac-93d6-4bd9-8531-7615e4c7412c None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.554760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 373/726] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:42.562060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7559-039f-4ce1-a7c2-12673b9dc546 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.562347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7559-039f-4ce1-a7c2-12673b9dc546 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.562608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7559-039f-4ce1-a7c2-12673b9dc546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.590967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-814c7559-039f-4ce1-a7c2-12673b9dc546 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:42.592955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-814c7559-039f-4ce1-a7c2-12673b9dc546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:42.636286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:42.636873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.637155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.637431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.639066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:42.639382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:42.640822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:42.660374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 354/727] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:42.667066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:42.747028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 374/728] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 07:39:42.748616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744500-f2b1-4be3-9869-fd2e7d135472 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.748909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744500-f2b1-4be3-9869-fd2e7d135472 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.749289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98744500-f2b1-4be3-9869-fd2e7d135472 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.750876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 375/729] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:42.764446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38160cf0-9ea4-49c6-b8cb-45f532f99dc0 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.764866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38160cf0-9ea4-49c6-b8cb-45f532f99dc0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.765251 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38160cf0-9ea4-49c6-b8cb-45f532f99dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.787853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-38160cf0-9ea4-49c6-b8cb-45f532f99dc0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:42.789067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-38160cf0-9ea4-49c6-b8cb-45f532f99dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:42.801553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e05e7a-f770-46c5-bb2d-722340203b83 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:42.836060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:42.842901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:42.843871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:42.844211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:42.844737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:42.859212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:42.860939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:42.876090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:42.877205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:42.878308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:42.878308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:42.878308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:42.878308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:42.879284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 376/730] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:42.880207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38160cf0-9ea4-49c6-b8cb-45f532f99dc0 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:42.880378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 355/731] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:42.886010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:42.896870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.021608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452e372-8b89-4521-9ac2-58e7efea6d61 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.022133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38160cf0-9ea4-49c6-b8cb-45f532f99dc0 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.056574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.057197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.057482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.057757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.057854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e79aa3-006a-46d9-81bd-53df771262a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.058457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:43.058616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79aa3-006a-46d9-81bd-53df771262a4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.058764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:43.058854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79aa3-006a-46d9-81bd-53df771262a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.059151 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79aa3-006a-46d9-81bd-53df771262a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.060157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:43.069716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e79aa3-006a-46d9-81bd-53df771262a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:43.077312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 356/732] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:43.077312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-b8e79aa3-006a-46d9-81bd-53df771262a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:43.077520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:43.078382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 377/733] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:43.079853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366a092-19b7-48e9-af6d-725db8ccf330 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.080600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366a092-19b7-48e9-af6d-725db8ccf330 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.080600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366a092-19b7-48e9-af6d-725db8ccf330 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.080600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 378/734] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:43.080600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366a092-19b7-48e9-af6d-725db8ccf330 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.131438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.143090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.186588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366a092-19b7-48e9-af6d-725db8ccf330 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.192507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137cf45-9093-465b-817d-7d96b8bd8e60 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.223384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.224032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.224317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.224596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.230785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f111b-c0d1-4a7d-b161-8466abc8b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.231974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f111b-c0d1-4a7d-b161-8466abc8b884 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.232439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:43.232612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f111b-c0d1-4a7d-b161-8466abc8b884 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.233059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f111b-c0d1-4a7d-b161-8466abc8b884 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.233915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:43.244244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f111b-c0d1-4a7d-b161-8466abc8b884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:43.245409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:43.246334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:43.247656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-532f111b-c0d1-4a7d-b161-8466abc8b884 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:43.249344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:43.250233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:43.251163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:43.251826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 379/735] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:43.252390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.255306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 357/736] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:43.256658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be797941-91b7-46dc-af51-1e49f58e9907 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.256955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be797941-91b7-46dc-af51-1e49f58e9907 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.257240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be797941-91b7-46dc-af51-1e49f58e9907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.277437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-be797941-91b7-46dc-af51-1e49f58e9907 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:43.278786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-be797941-91b7-46dc-af51-1e49f58e9907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:43.348961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 358/737] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 07:39:43.352127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be797941-91b7-46dc-af51-1e49f58e9907 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.359613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb4df-890c-40b6-8acc-a5fdf7b75aa3 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.383855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.397201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.397819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.398414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.398686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.399017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.399856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:43.400166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:43.401569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:43.409818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 380/738] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:43.410610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.473219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be797941-91b7-46dc-af51-1e49f58e9907 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.507309 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.507932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.508778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.509066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.509893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:43.510205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:43.511670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:43.515042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214e82f-e471-4d45-91b6-e5587e8c6ac5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.529441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 359/739] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:43.530132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.553133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.553753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.554034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.554310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.555562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:43.555880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:43.557251 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:43.569669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 381/740] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:43.569669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.615643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.628384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.638669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4465-4481-4825-b319-9a51ee1f528a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.675545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c63e-ed21-49b1-a5f1-9b90439d923d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.675731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7743e6-ea94-46ae-95ad-f8bc667ca341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.676298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7743e6-ea94-46ae-95ad-f8bc667ca341 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.676578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7743e6-ea94-46ae-95ad-f8bc667ca341 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.676853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7743e6-ea94-46ae-95ad-f8bc667ca341 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.677543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7743e6-ea94-46ae-95ad-f8bc667ca341 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:43.678908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7743e6-ea94-46ae-95ad-f8bc667ca341 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:43.696802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 360/741] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:39:43 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:43.697625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7743e6-ea94-46ae-95ad-f8bc667ca341 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.736035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.737721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.738189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.738635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.755701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:43.759101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:43.781729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:43.782891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:43.784033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:43.784033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:43.784033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:43.784033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:43.786972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 382/742] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:43.788162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.833548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7743e6-ea94-46ae-95ad-f8bc667ca341 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.876026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:43.877108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:43.877108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:43.877282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:43.891850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:43.893311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:43.909349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:43.910266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:43.911189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:43.911189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:43.911189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:43.911189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:43.911752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 361/743] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:43.912578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:43.918104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.946161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:43.956820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd23b8-880a-4f80-9cb1-6a305dadeac5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:43.999537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.000108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.000397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.000674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.012749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.014250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:44.031159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:44.032484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:44.033371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:44.033371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:44.033371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:44.033371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:44.036943 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 383/744] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:44.037816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.043474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537900e-b87f-495d-b30d-91c672631104 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.087887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.089074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.089551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.090149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.091322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:44.091826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.093368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.114770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 362/745] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:44.116766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.147373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be6d9c-67fb-477c-872b-0fdf8613b88f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.186235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.186869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.187197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.187474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.188175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:44.188484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.189998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.201766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:44.207032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 384/746] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:44.207989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.218084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:44.253350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120a1cb-9aa8-4915-9751-17e1fe5ab700 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.295928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.296701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.297005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.297285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.298768 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:44.299126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.300579 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.319271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 363/747] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:44.320421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.335249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04a97-ada5-4bf9-bbb9-a2262681b8bc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.373556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.374209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.374493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.374770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.383746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.385325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:44.398729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:44.399735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:44.400648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:44.404686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 385/748] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:44.405737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.430793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a736599-7434-4d25-be6c-2c7b493f20e7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.455565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:44.467278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.468221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.468695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.469197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.476409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.478623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.479976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:44.491222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:44.492118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:44.493565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:44.493565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:44.493565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:44.493565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:44.493565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:44.493565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:44.493565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:44.493565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:44.496013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 364/749] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:44.496982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.525838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc93d0-d672-4daa-94b2-63fda9fc699e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.564223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.564870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.565156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.565477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.573970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.575478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:44.588733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:44.589698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:39:44.590623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:44.594865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 386/750] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:44.595756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.607690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f76a0-db39-47d1-9c58-b7f0c2e7b11b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.642215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.643180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.643655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.644449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.645419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:44.645899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.647540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.666747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 365/751] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:44.667877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.710450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:44.714895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463ca92-56a1-4d7d-879f-837f7bb05648 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.743170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:44.753328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.754115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.754228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.754479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.755260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:44.755562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.757348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.774794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 387/752] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:44.774794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.775075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d21a6e-0950-4d6e-abc6-98b6c1909504 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.811137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22fc85-5666-4eee-8b90-4b737159d999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.811771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22fc85-5666-4eee-8b90-4b737159d999 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.812118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22fc85-5666-4eee-8b90-4b737159d999 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.812491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22fc85-5666-4eee-8b90-4b737159d999 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.813356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22fc85-5666-4eee-8b90-4b737159d999 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:44.813666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22fc85-5666-4eee-8b90-4b737159d999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.815125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22fc85-5666-4eee-8b90-4b737159d999 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:44.832977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 366/753] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:44.839292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b965c3-3520-420c-b762-ce6cbdde71a3 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.839589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b965c3-3520-420c-b762-ce6cbdde71a3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.839874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b965c3-3520-420c-b762-ce6cbdde71a3 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.845283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 367/754] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:44.845283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b965c3-3520-420c-b762-ce6cbdde71a3 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:44.890478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c90be-0365-44e1-afc6-0ce0c37ce5a8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.931750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df49ee4-7ade-4e01-892d-d69ec2f7f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.932371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df49ee4-7ade-4e01-892d-d69ec2f7f43d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.932769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df49ee4-7ade-4e01-892d-d69ec2f7f43d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.933043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df49ee4-7ade-4e01-892d-d69ec2f7f43d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.951033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:44.955278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b965c3-3520-420c-b762-ce6cbdde71a3 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:44.993817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:44.994994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bccc82-6cb3-4f00-8e7f-4afc823c90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:44.995628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bccc82-6cb3-4f00-8e7f-4afc823c90cf None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:44.995883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bccc82-6cb3-4f00-8e7f-4afc823c90cf None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:44.996161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bccc82-6cb3-4f00-8e7f-4afc823c90cf None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/867e92c5301945a88e5c0ed06c4b7257/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:44.998373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bccc82-6cb3-4f00-8e7f-4afc823c90cf None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=867e92c5301945a88e5c0ed06c4b7257, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:44.999979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bccc82-6cb3-4f00-8e7f-4afc823c90cf None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.009974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df49ee4-7ade-4e01-892d-d69ec2f7f43d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:45.011742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df49ee4-7ade-4e01-892d-d69ec2f7f43d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.012909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 368/755] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:39:44 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/867e92c5301945a88e5c0ed06c4b7257/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:39:45.013494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bccc82-6cb3-4f00-8e7f-4afc823c90cf None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.131786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bccc82-6cb3-4f00-8e7f-4afc823c90cf None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:45.154580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 388/756] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:39:45.156679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e00720-7c94-473e-b06e-2dbefb9633fe None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.157147 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e00720-7c94-473e-b06e-2dbefb9633fe None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.157624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e00720-7c94-473e-b06e-2dbefb9633fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.171810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997d93d-4efc-42bc-9db9-117c48d0ed4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:45.172440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d93d-4efc-42bc-9db9-117c48d0ed4c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.172730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d93d-4efc-42bc-9db9-117c48d0ed4c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.173008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d93d-4efc-42bc-9db9-117c48d0ed4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.178153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-d1e00720-7c94-473e-b06e-2dbefb9633fe None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:45.179381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d1e00720-7c94-473e-b06e-2dbefb9633fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:45.203630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:45.259935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 389/757] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:45.260523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997d93d-4efc-42bc-9db9-117c48d0ed4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:45.261406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e00720-7c94-473e-b06e-2dbefb9633fe None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.262037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997d93d-4efc-42bc-9db9-117c48d0ed4c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.294228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:45.386588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e00720-7c94-473e-b06e-2dbefb9633fe None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:45.412259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 369/758] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:39:45.413449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997d93d-4efc-42bc-9db9-117c48d0ed4c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.428585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:45.429239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.429523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.429800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.442285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:45.443778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:45.464262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:45.465191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:45.466082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:45.466082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:45.466082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:45.466082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:45.470448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 390/759] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:45.471338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.492340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:45.536275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997d93d-4efc-42bc-9db9-117c48d0ed4c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:45.550496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:45.572747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:45.573402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.573689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.573967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.574611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:45.576122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:45.587426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:45.588401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:45.589240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:45.593680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 370/760] 10.222.0.46 () {56 vars in 1129 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:45.594368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.597045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35cdb4-045b-4ab1-bfc2-1f2c50db992e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:45.635274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:45.636259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.636867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.637350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.649590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:45.651426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:45.667558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:45.668502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:45.669382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:45.669382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:45.669382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:45.669382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:45.671593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 391/761] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:45.672605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.705628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84879bc8-e1c3-4dd6-8220-b45ab4ae10ec None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:45.730370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:45.741987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:45.744374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.744676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.745058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.745877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:45.746323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:45.747854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.765831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 371/762] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:45.766857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.787650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946dc04-44f4-4d9b-af4d-4d4581c1345d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:45.809996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:45.827217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:45.828161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.828714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.828999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.829672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:45.829982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:45.831500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.836380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 392/763] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:45.837136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.879142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfc17e-2576-4098-95e0-7459c3db2547 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:45.914741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5845b38-82ec-44ea-b3b6-5e280d2c97df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:45.915386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845b38-82ec-44ea-b3b6-5e280d2c97df None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.915776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845b38-82ec-44ea-b3b6-5e280d2c97df None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.915944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845b38-82ec-44ea-b3b6-5e280d2c97df None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.916635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5845b38-82ec-44ea-b3b6-5e280d2c97df None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:45.916941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5845b38-82ec-44ea-b3b6-5e280d2c97df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:45.918310 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5845b38-82ec-44ea-b3b6-5e280d2c97df None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:45.934092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 372/764] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:45.934092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f46281-b35e-4d57-be3a-a5c3d9863d16 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.934092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f46281-b35e-4d57-be3a-a5c3d9863d16 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.934092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f46281-b35e-4d57-be3a-a5c3d9863d16 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:45.934092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 373/765] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:45.934092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f46281-b35e-4d57-be3a-a5c3d9863d16 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:45.955075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3befec-845e-4f63-83e6-bafdbde55ecd None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:45.984583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:45.991575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:45.993187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:45.993187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:45.993443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.000885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.002564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:46.014744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:46.015792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:46.016801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 393/766] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:46.017295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.046325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f46281-b35e-4d57-be3a-a5c3d9863d16 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.066474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:46.081455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258929c-13fe-487a-82a9-7f5dd313920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.082069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258929c-13fe-487a-82a9-7f5dd313920b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.082349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258929c-13fe-487a-82a9-7f5dd313920b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.082695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258929c-13fe-487a-82a9-7f5dd313920b None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.083337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258929c-13fe-487a-82a9-7f5dd313920b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:46.083644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258929c-13fe-487a-82a9-7f5dd313920b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.085015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258929c-13fe-487a-82a9-7f5dd313920b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.091193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 374/767] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jul 26 07:39:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:46.092361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ba36-15ad-41f5-8606-660957b03d18 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.092648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ba36-15ad-41f5-8606-660957b03d18 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.092925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ba36-15ad-41f5-8606-660957b03d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.112301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5171ba36-15ad-41f5-8606-660957b03d18 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:46.113511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5171ba36-15ad-41f5-8606-660957b03d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:46.130305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c65667-684e-49dc-9b5d-63b2d0387eac None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.169520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.170170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.170363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.170646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.178420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.180001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.189213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 375/768] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:46.190626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ba36-15ad-41f5-8606-660957b03d18 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:46.191786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:46.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:46.193525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:46.193525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:46.193525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:46.193525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:46.193525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:46.193525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:46.193525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:46.193525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:46.198094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 394/769] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:46.198969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.244363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:46.302607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a108a-5d5c-4800-917c-dd5aa54113d1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.305393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:46.309822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ba36-15ad-41f5-8606-660957b03d18 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.337288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.337915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.338198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.338471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.339273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] RBAC: Adding query filter params (interface=public, service_id=f145debe3e1c4a7c9e466dbf7d52dd41, region_id=RegionOne) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:46.339585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.340926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.346609 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.347453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.347940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.348113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 395/770] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/endpoints?service_id=f145debe3e1c4a7c9e466dbf7d52dd41&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:46.348541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.348882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.349811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:46.350312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.352081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.364352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 376/771] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:46.365159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.459686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254a994-1818-41d7-9955-4aa64d4b7a28 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.466612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:46.470540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25958d77-e3a4-4da3-a81f-eeb44a920cfa None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.496681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.497304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.497596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.497874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.498622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:46.498950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.500388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.506118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.506768 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.507078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.507354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.508010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.509870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.518362 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 396/772] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:46.518362 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:46.524761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:46.525793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:46.526611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:46.530643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 377/773] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:46.531505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.546828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:46.629320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b05b1-53dc-44b2-b107-8c051d9b931e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.637076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d636a4-f566-4446-adf3-eae3d138b4e3 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.671581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5436e52-9283-4998-b798-8dc8ce40e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.672210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5436e52-9283-4998-b798-8dc8ce40e052 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.672491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5436e52-9283-4998-b798-8dc8ce40e052 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.672766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5436e52-9283-4998-b798-8dc8ce40e052 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.673429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5436e52-9283-4998-b798-8dc8ce40e052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.674846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5436e52-9283-4998-b798-8dc8ce40e052 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.677311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.678079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.678366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.678642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.679722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=de1dd35abd2e4db0bda795191eeee287) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:46.688367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.688556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 397/774] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:46.688556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5436e52-9283-4998-b798-8dc8ce40e052 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.688719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.688719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 378/775] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/role_assignments?user.id=de1dd35abd2e4db0bda795191eeee287&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=53894f3146884908ba6dd3e118397fb3 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:46.689017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:46.743025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:46.860181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:46.872903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5436e52-9283-4998-b798-8dc8ce40e052 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.911703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3349b3-d24c-44ad-a97a-29cd9bdb6651 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:46.913370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.914725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.915127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.915409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.916209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=a6d078f161bc415ca00848947b9cd947) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:46.916586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.918039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.925080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 398/776] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/role_assignments?user.id=a6d078f161bc415ca00848947b9cd947&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:46.954769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16abf73-ac21-4441-9ac1-32f6fceac30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:46.955471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16abf73-ac21-4441-9ac1-32f6fceac30b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:46.955757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16abf73-ac21-4441-9ac1-32f6fceac30b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:46.956033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16abf73-ac21-4441-9ac1-32f6fceac30b None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:46.956807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16abf73-ac21-4441-9ac1-32f6fceac30b None admin] RBAC: Adding query filter params (name=network) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:46.957119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16abf73-ac21-4441-9ac1-32f6fceac30b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:46.958601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16abf73-ac21-4441-9ac1-32f6fceac30b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:46.964433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 379/777] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:46.969972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:47.083830 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d2712-5053-4d24-8b7c-a3902a149cf4 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:47.084137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d2712-5053-4d24-8b7c-a3902a149cf4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:47.084321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d2712-5053-4d24-8b7c-a3902a149cf4 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:47.085737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 380/778] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:47.091863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a5ec-223c-4d5c-9e0a-32d96323710c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:47.092153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a5ec-223c-4d5c-9e0a-32d96323710c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:47.092417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a5ec-223c-4d5c-9e0a-32d96323710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:47.111956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf788fb-ac1a-4123-8ae2-228dd0e95b6a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:47.122865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d867a5ec-223c-4d5c-9e0a-32d96323710c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:47.122865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d867a5ec-223c-4d5c-9e0a-32d96323710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:47.153095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:47.153726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:47.154005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:47.154274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:47.155016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] RBAC: Adding query filter params (type=network) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:47.155297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:47.156667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:47.162028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 399/779] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:39:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:47.172133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:47.195163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:47.212967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 381/780] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:39:47.275275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867a5ec-223c-4d5c-9e0a-32d96323710c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:47.314988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2be85-3981-4029-8ca3-32633d371dc1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:47.318957 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:47.362077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:47.362634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:47.362922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:47.363218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:47.363989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] RBAC: Adding query filter params (interface=public, service_id=49c22c2c1c6c43859f2beac0e45f900a, region_id=RegionOne) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:47.364300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:47.365679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:47.371589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 400/781] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jul 26 07:39:47 2022] GET /identity/v3/endpoints?service_id=49c22c2c1c6c43859f2beac0e45f900a&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:47.376863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:47.412842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867a5ec-223c-4d5c-9e0a-32d96323710c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:47.483862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf27ce-e50f-4643-8e45-cbbda1fa8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:47.484520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf27ce-e50f-4643-8e45-cbbda1fa8117 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:47.484796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf27ce-e50f-4643-8e45-cbbda1fa8117 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:47.485070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf27ce-e50f-4643-8e45-cbbda1fa8117 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:47.503085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:47.504577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf27ce-e50f-4643-8e45-cbbda1fa8117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-5fbf27ce-e50f-4643-8e45-cbbda1fa8117 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:47.510134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:47.511087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:47.511917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:47.518645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 382/782] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:47.519813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf27ce-e50f-4643-8e45-cbbda1fa8117 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:47.533033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991fd63-7de4-4540-8358-68cdac75956c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:47.601115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27043-9900-4f81-9039-4ff81ee2c800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:47.601803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27043-9900-4f81-9039-4ff81ee2c800 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:47.602086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27043-9900-4f81-9039-4ff81ee2c800 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:47.602361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f27043-9900-4f81-9039-4ff81ee2c800 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:47.603051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f27043-9900-4f81-9039-4ff81ee2c800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:47.604429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f27043-9900-4f81-9039-4ff81ee2c800 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:47.619435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 401/783] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:39:47 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:47.635555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:47.658695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf27ce-e50f-4643-8e45-cbbda1fa8117 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:47.697429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:47.698074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:47.698360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:47.698636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:47.699407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:47.699719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:47.701158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:47.711733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 383/784] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:47.717138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27043-9900-4f81-9039-4ff81ee2c800 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:47.838774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f27043-9900-4f81-9039-4ff81ee2c800 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:47.873950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:47.874522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:47.874802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:47.875105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:47.886501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:47.887968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:47.896394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:47.903204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:47.904089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:47.904968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:47.904968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:47.904968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:47.904968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:47.904968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 402/785] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:47.911290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:48.043913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad63cd-733f-469c-a5c7-b20196347441 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:48.086754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:48.087451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:48.087736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:48.088008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:48.088697 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:48.089002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:48.090361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:48.105961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 384/786] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:48.111498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:48.221158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e781d0-56a9-4834-af85-ec555b78ccfe None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:48.255740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:48.256386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:48.256667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:48.256941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:48.264870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:48.266306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:48.278019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:48.278963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:48.279917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 403/787] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:39:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:48.288126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:48.291828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:48.411082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3add388-ce0c-4dfe-857a-93cc7dbad557 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:48.466052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b0c2c-cb84-4f93-89ab-b23465570822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:48.466687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0c2c-cb84-4f93-89ab-b23465570822 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:48.466998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0c2c-cb84-4f93-89ab-b23465570822 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:48.467279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0c2c-cb84-4f93-89ab-b23465570822 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:48.468088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b0c2c-cb84-4f93-89ab-b23465570822 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:48.468396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b0c2c-cb84-4f93-89ab-b23465570822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:48.469829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b0c2c-cb84-4f93-89ab-b23465570822 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:48.496891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 385/788] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:39:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:48.502720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:48.602352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:48.677733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523b4ba-56a7-42ba-9160-e1a334fc8956 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:48.754197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613c622-67d4-499f-83fa-e3a0c606d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:48.754747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613c622-67d4-499f-83fa-e3a0c606d24e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:48.755055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613c622-67d4-499f-83fa-e3a0c606d24e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:48.755330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613c622-67d4-499f-83fa-e3a0c606d24e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:48.861101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613c622-67d4-499f-83fa-e3a0c606d24e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:48.862587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613c622-67d4-499f-83fa-e3a0c606d24e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:48.939673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:48.969401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c658c8-ba52-4488-b066-7d0e3e9181c0 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:48.970085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c658c8-ba52-4488-b066-7d0e3e9181c0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:48.970570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c658c8-ba52-4488-b066-7d0e3e9181c0 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:48.972157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 386/789] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:48.982138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262445-ec6b-4141-9513-47f03049b9bd None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:48.982428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262445-ec6b-4141-9513-47f03049b9bd None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:48.982704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262445-ec6b-4141-9513-47f03049b9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.003249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5e262445-ec6b-4141-9513-47f03049b9bd None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:49.004544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5e262445-ec6b-4141-9513-47f03049b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:49.005646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 404/790] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:39:49.011637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613c622-67d4-499f-83fa-e3a0c606d24e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.120410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:49.157340 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613c622-67d4-499f-83fa-e3a0c606d24e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:49.161203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 387/791] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:49.187126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef958-8f75-40a5-b225-191b70d21fa9 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.187434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef958-8f75-40a5-b225-191b70d21fa9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.187687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ef958-8f75-40a5-b225-191b70d21fa9 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.189277 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 388/792] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:39:49.192446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:49.193096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.193378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.193649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.194088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819ace-19af-4542-a783-be215eae4d46 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.194374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819ace-19af-4542-a783-be215eae4d46 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.194651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819ace-19af-4542-a783-be215eae4d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.205554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:49.207170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:49.215011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9a819ace-19af-4542-a783-be215eae4d46 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:49.216564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9a819ace-19af-4542-a783-be215eae4d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:49.223143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:49.224359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:49.225785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:49.225785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:49.225785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:49.225785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:49.225785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 405/793] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:49.225785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.240809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:49.316275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 389/794] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:39:49.317764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819ace-19af-4542-a783-be215eae4d46 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.351528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230376f1-7b6d-4afa-bbb4-3afd1819166a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:49.394832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d956-31a6-4cc0-aac2-5e5079f0954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:49.395513 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d956-31a6-4cc0-aac2-5e5079f0954a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.395795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d956-31a6-4cc0-aac2-5e5079f0954a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.396069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5d956-31a6-4cc0-aac2-5e5079f0954a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.409790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5d956-31a6-4cc0-aac2-5e5079f0954a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-66c5d956-31a6-4cc0-aac2-5e5079f0954a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:49.416977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:49.417909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:49.419444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:49.423375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 406/795] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:49.424469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d956-31a6-4cc0-aac2-5e5079f0954a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.433703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819ace-19af-4542-a783-be215eae4d46 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:49.456003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:49.471395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:49.472015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.472297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.472572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.473393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:49.473752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:49.475331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:49.488012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 390/796] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:49.488843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.512218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:49.551130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5d956-31a6-4cc0-aac2-5e5079f0954a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:49.587172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:49.587751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.588031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.588311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.588942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:49.590309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:49.599971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:49.600951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 07:39:49.601809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:49.602591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f999f-5c86-434b-a955-320f8bf3b329 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:49.602664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 407/797] 10.222.0.46 () {56 vars in 1129 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:49.602664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.640888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b92332-3b17-4764-bcb4-d1c447241f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:49.641506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92332-3b17-4764-bcb4-d1c447241f1a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.641787 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92332-3b17-4764-bcb4-d1c447241f1a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.642058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92332-3b17-4764-bcb4-d1c447241f1a None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.642766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b92332-3b17-4764-bcb4-d1c447241f1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:49.643097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b92332-3b17-4764-bcb4-d1c447241f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:49.644721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b92332-3b17-4764-bcb4-d1c447241f1a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:49.657359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 391/798] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:49.657359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60f9a-c0a5-40ec-be0b-85d2586581be None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.657359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60f9a-c0a5-40ec-be0b-85d2586581be None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.657359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60f9a-c0a5-40ec-be0b-85d2586581be None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.657359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 392/799] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:49.657359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c60f9a-c0a5-40ec-be0b-85d2586581be None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.705938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:49.718692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29ee1b-c839-49a3-b379-e5a49686724e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:49.755767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:49.756422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.757119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.757400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.761069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:49.766969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:49.768372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:49.769969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c60f9a-c0a5-40ec-be0b-85d2586581be None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:49.782221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:49.783130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:49.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 408/800] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:49.784501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.810151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8eff2-299c-4b86-8e6c-f8caa04712a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:49.810772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eff2-299c-4b86-8e6c-f8caa04712a9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.811083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eff2-299c-4b86-8e6c-f8caa04712a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.811357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eff2-299c-4b86-8e6c-f8caa04712a9 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.812035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8eff2-299c-4b86-8e6c-f8caa04712a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:49.812342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8eff2-299c-4b86-8e6c-f8caa04712a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:49.813706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8eff2-299c-4b86-8e6c-f8caa04712a9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:49.818320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 393/801] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:49.819492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6978c1-9ab5-4b84-8e70-4b3807440149 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.819777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6978c1-9ab5-4b84-8e70-4b3807440149 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.820052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6978c1-9ab5-4b84-8e70-4b3807440149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.837526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-2d6978c1-9ab5-4b84-8e70-4b3807440149 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:49.838657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2d6978c1-9ab5-4b84-8e70-4b3807440149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:49.902285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732875b-cae1-4e1f-843f-344aa7cd2a49 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:49.911335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 394/802] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:49.911335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6978c1-9ab5-4b84-8e70-4b3807440149 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:49.939325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:49.939979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:49.940257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:49.940520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:49.951528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:49.952961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:49.956581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:49.967433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:49.968414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:49.969301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:49.969301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:49.969301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:49.969301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:49.969301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 409/803] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:49.969582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.019723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:50.030883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6978c1-9ab5-4b84-8e70-4b3807440149 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.069065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.069693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.069980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.070260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.071086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:50.071408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:50.072857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:50.075710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b152528-a067-42e2-a5d7-5c6e576f4661 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.084816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 395/804] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:50.085633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.117977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.118530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.118812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.119314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.119796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:50.120102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:50.121604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:50.131368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 410/805] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jul 26 07:39:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:50.131368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.193017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:50.200306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52435-1a58-4d6a-9664-34b4c06a5708 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.236751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae114f7-fa46-4f65-bbde-817b1088183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.237403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae114f7-fa46-4f65-bbde-817b1088183e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.237688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae114f7-fa46-4f65-bbde-817b1088183e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.237786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ae3f2-1890-4af7-be45-5908cc8d4a94 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.238195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae114f7-fa46-4f65-bbde-817b1088183e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.248489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae114f7-fa46-4f65-bbde-817b1088183e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:50.251294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-dae114f7-fa46-4f65-bbde-817b1088183e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:50.254307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:50.255585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:50.256418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 396/806] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:50.257091 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae114f7-fa46-4f65-bbde-817b1088183e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.279677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.280303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.280596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.280850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.281542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:50.281847 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:50.283323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:50.296068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 411/807] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:50.296692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.372587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae114f7-fa46-4f65-bbde-817b1088183e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.398721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9c12b-e096-4fbe-ace3-c42d80a3f06a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.405295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.405924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.406207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.406484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.407318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=867e92c5301945a88e5c0ed06c4b7257) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:50.407635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:50.409080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:50.415008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 397/808] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:50 2022] GET /identity/v3/role_assignments?user.id=867e92c5301945a88e5c0ed06c4b7257&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=53894f3146884908ba6dd3e118397fb3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:50.415604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.440430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:50.450452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038ba1-4c8d-40e0-8a83-264541cf05ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.451693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038ba1-4c8d-40e0-8a83-264541cf05ee None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.452155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038ba1-4c8d-40e0-8a83-264541cf05ee None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.452460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038ba1-4c8d-40e0-8a83-264541cf05ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.453307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0038ba1-4c8d-40e0-8a83-264541cf05ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:50.455794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0038ba1-4c8d-40e0-8a83-264541cf05ee None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:50.482538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 412/809] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:39:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:50.483443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038ba1-4c8d-40e0-8a83-264541cf05ee None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.527610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:50.549932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bbfdf-2947-452c-a66e-aef9caf706a1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.600055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb977f80-c9ef-4b1a-9f75-e6be312d19dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.600677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977f80-c9ef-4b1a-9f75-e6be312d19dc None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.600962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977f80-c9ef-4b1a-9f75-e6be312d19dc None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.601235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977f80-c9ef-4b1a-9f75-e6be312d19dc None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.602511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb977f80-c9ef-4b1a-9f75-e6be312d19dc None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:50.602814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb977f80-c9ef-4b1a-9f75-e6be312d19dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:50.604257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb977f80-c9ef-4b1a-9f75-e6be312d19dc None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:50.618148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 398/810] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:50.619135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374f02-26f2-4216-9c6c-1989232360c9 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.619428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374f02-26f2-4216-9c6c-1989232360c9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.620003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374f02-26f2-4216-9c6c-1989232360c9 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.621160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 399/811] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:50.626116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90374f02-26f2-4216-9c6c-1989232360c9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.643142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038ba1-4c8d-40e0-8a83-264541cf05ee None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.692101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79c367-dcac-460c-8ef6-c0e43a214fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.692785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79c367-dcac-460c-8ef6-c0e43a214fd2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.693067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79c367-dcac-460c-8ef6-c0e43a214fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.693338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79c367-dcac-460c-8ef6-c0e43a214fd2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.704029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79c367-dcac-460c-8ef6-c0e43a214fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:50.705484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79c367-dcac-460c-8ef6-c0e43a214fd2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-9e79c367-dcac-460c-8ef6-c0e43a214fd2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:50.718957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:50.720113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:50.721260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:50.724733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 413/812] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:50.725897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19960-5133-4cac-a3dd-c25f0088492f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.726190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19960-5133-4cac-a3dd-c25f0088492f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.726469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19960-5133-4cac-a3dd-c25f0088492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.734123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:50.746148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-93f19960-5133-4cac-a3dd-c25f0088492f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:50.749628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-93f19960-5133-4cac-a3dd-c25f0088492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:50.760025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90374f02-26f2-4216-9c6c-1989232360c9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.800712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:50.801418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:50.801704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:50.802006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:50.815513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:50.817028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:50.832345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:50.833427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:50.834510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:50.834510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:50.834510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:50.834510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:50.834510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 400/813] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:50.834833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.850698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 414/814] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:50.852973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f19960-5133-4cac-a3dd-c25f0088492f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:50.885370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:50.985314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01872eb9-99e2-4f64-9afd-f019f0d5eb39 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:50.987848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f19960-5133-4cac-a3dd-c25f0088492f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.024261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:51.025151 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.025934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.026356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.026758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.027699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:51.031949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.031949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.032113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.032113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.032534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.032914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.033803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:51.034187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.036204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.048651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 415/815] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:51.049698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.064394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 401/816] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jul 26 07:39:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:51.065344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.159532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:51.173024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f5bc-1984-41f4-bfa1-6c53226a486c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.184587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd24b-0e26-41a5-9327-93120088dba6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.212815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.213777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.214329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.214815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.220076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.220736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.221021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.221352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] PATH_INFO: `/v3/services/network` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.221997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.223431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.224172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.225775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:51.233499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:51.234514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 07:39:51.235382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:51.239079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 416/817] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:51.239917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:51.244633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:51.245526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:39:51.246466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:51.249050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 402/818] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:51.250132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.301698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:51.347515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b6659-5a7f-4d92-9585-4b1ca658006a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.358137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6f35b-8b42-4d5b-9cd1-4a85fab2414e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.384170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.384851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.385141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.385684 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.396760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.396983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.398141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.398248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.398939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.399411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.399964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:51.400853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] RBAC: Adding query filter params (name=network) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:51.401415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.403078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.408240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 403/819] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:51.409212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:51.418962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:51.419846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:51.420717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:51.420717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:51.420717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:51.420717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:51.420717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 417/820] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:51.421406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.518134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9051159-cadc-4ba5-a250-aa1ab827a47a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.523198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0253a-e74e-467a-b432-caaf239aede1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.532026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:51.557204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.558316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.558815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.558920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.559455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.559558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.559787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.560146 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.560831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] RBAC: Adding query filter params (type=network) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:51.561143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.561385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:51.561877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.562570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.563776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.572480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 418/821] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:51.573488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.584207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 404/822] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:51.585300 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.655329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:51.682369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930eccd-c370-49bb-8db8-74bbcfddf8af None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.692131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1511-a650-48f2-b118-49f91f593587 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.719809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.720438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.720725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.721003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.721863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:51.722182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.723775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.731185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca2d7-9417-48a2-a586-409877f833d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.732141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca2d7-9417-48a2-a586-409877f833d0 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.732652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca2d7-9417-48a2-a586-409877f833d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.733147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca2d7-9417-48a2-a586-409877f833d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.734091 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca2d7-9417-48a2-a586-409877f833d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.735922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca2d7-9417-48a2-a586-409877f833d0 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.737871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 419/823] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:51.738947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.763462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 405/824] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:39:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:51.764731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca2d7-9417-48a2-a586-409877f833d0 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:51.797365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:51.892178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca2d7-9417-48a2-a586-409877f833d0 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.931115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e06a98-ace6-4ce5-ba67-fa3a4a39bce2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:51.933510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:51.934430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:51.935194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:51.935685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:51.943540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:51.945345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:51.958614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:51.959397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:51.960266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:51.961718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:51.961718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:51.961718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:51.961718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:51.961718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:51.961718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:51.961718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:51.961718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:51.964714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 406/825] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:51.971604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:52.010790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:52.011727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.012152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.012564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.033014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:52.034508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:52.061176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:52.062278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:52.063412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:52.063412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:52.063412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:52.063412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:52.066072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 420/826] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:52.073019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:52.112515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:52.143695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d87f6-d431-49ad-afa6-f97ba73d3946 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:52.180946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:52.181930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.182459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.182951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.184164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:52.184890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:52.187376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:52.204297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 407/827] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:52.209874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:52.219855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94771359-fd20-4f93-9ac7-12b75ba65b91 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:52.274630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:52.275437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.275628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.275905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.277031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:52.277350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:52.279058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:52.299243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 421/828] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:52.301484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:52.344633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:52.359744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb7f6-5bf5-4be6-9541-42640b8a11ff None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:52.408163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39bba-83c2-452e-93a0-8d2ba789fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:52.408930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39bba-83c2-452e-93a0-8d2ba789fb4d None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.409128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39bba-83c2-452e-93a0-8d2ba789fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.409386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39bba-83c2-452e-93a0-8d2ba789fb4d None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/de1dd35abd2e4db0bda795191eeee287/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.411730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a39bba-83c2-452e-93a0-8d2ba789fb4d None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=de1dd35abd2e4db0bda795191eeee287, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:52.413667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a39bba-83c2-452e-93a0-8d2ba789fb4d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:52.426898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7d5e6-e5d5-446d-9bbf-8c5e0df9e19e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:52.431228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 408/829] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:39:52 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/de1dd35abd2e4db0bda795191eeee287/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:39:52.467975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d10c7-8f83-41c0-aedc-8dccd882ffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:52.468985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d10c7-8f83-41c0-aedc-8dccd882ffc3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.469556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d10c7-8f83-41c0-aedc-8dccd882ffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.470050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d10c7-8f83-41c0-aedc-8dccd882ffc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.478821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d10c7-8f83-41c0-aedc-8dccd882ffc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:52.480717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d10c7-8f83-41c0-aedc-8dccd882ffc3 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-397d10c7-8f83-41c0-aedc-8dccd882ffc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:52.494482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:52.495772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:52.496685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:52.496685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:52.496685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:52.496685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:52.496685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:52.496685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:52.496685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:52.496685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:52.499365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 422/830] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:52.505710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39bba-83c2-452e-93a0-8d2ba789fb4d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:52.509852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:52.591944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066e14-a2fc-4e82-8b85-9f8285dc39e1 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.592305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066e14-a2fc-4e82-8b85-9f8285dc39e1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.592496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066e14-a2fc-4e82-8b85-9f8285dc39e1 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.594128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 423/831] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:39:52.599646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48910-dc75-49f8-b82a-ddb34c8463b2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.599980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48910-dc75-49f8-b82a-ddb34c8463b2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.600202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48910-dc75-49f8-b82a-ddb34c8463b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.622489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-11d48910-dc75-49f8-b82a-ddb34c8463b2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:52.624588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-11d48910-dc75-49f8-b82a-ddb34c8463b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:52.647014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39bba-83c2-452e-93a0-8d2ba789fb4d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:52.686742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc9633-a98b-420e-bf52-cb956388f594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:52.687801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9633-a98b-420e-bf52-cb956388f594 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.688287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9633-a98b-420e-bf52-cb956388f594 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.688766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9633-a98b-420e-bf52-cb956388f594 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.690197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc9633-a98b-420e-bf52-cb956388f594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:52.690772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc9633-a98b-420e-bf52-cb956388f594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:52.693521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc9633-a98b-420e-bf52-cb956388f594 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:52.712736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 409/832] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:52.714018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee0f2-5d07-4c1e-bdcd-ed3c3df699e9 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.714307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee0f2-5d07-4c1e-bdcd-ed3c3df699e9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.714583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee0f2-5d07-4c1e-bdcd-ed3c3df699e9 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.716053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 410/833] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:52.718949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee0f2-5d07-4c1e-bdcd-ed3c3df699e9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:52.719249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 424/834] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:39:52.724556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eae780-9012-4d56-a4bb-02b0944f92f5 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.724845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eae780-9012-4d56-a4bb-02b0944f92f5 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.725121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eae780-9012-4d56-a4bb-02b0944f92f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.748590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c4eae780-9012-4d56-a4bb-02b0944f92f5 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:52.749791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c4eae780-9012-4d56-a4bb-02b0944f92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:52.763788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:52.792717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:52.819701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 425/835] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:39:52.823613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eae780-9012-4d56-a4bb-02b0944f92f5 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:52.843352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee0f2-5d07-4c1e-bdcd-ed3c3df699e9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:52.882745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0776-d756-4680-a837-a6b384098bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:52.883579 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0776-d756-4680-a837-a6b384098bf1 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:52.883922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0776-d756-4680-a837-a6b384098bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:52.884266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0776-d756-4680-a837-a6b384098bf1 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/a6d078f161bc415ca00848947b9cd947/roles/a30240f5fb7d4b76a899eaed2f4cf878` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:52.899928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c0776-d756-4680-a837-a6b384098bf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=a6d078f161bc415ca00848947b9cd947, role_id=a30240f5fb7d4b76a899eaed2f4cf878)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:52.901493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c0776-d756-4680-a837-a6b384098bf1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:52.916969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 411/836] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:39:52 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/a6d078f161bc415ca00848947b9cd947/roles/a30240f5fb7d4b76a899eaed2f4cf878 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:39:52.918123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0776-d756-4680-a837-a6b384098bf1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:52.954398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eae780-9012-4d56-a4bb-02b0944f92f5 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:53.000479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:53.001091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:53.001372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:53.001644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:53.002360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:53.004225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:53.015119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:53.016144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:53.016977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 426/837] 10.222.0.46 () {56 vars in 1132 bytes} [Tue Jul 26 07:39:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:53.022967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:53.042690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:53.083946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0776-d756-4680-a837-a6b384098bf1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:53.105795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:53.131142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:53.131805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:53.132468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:53.132750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:53.133721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:53.135282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:53.147459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:53.149052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:53.149899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 412/838] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:53.153457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e944c-0391-4607-85c6-6a5fef8d25b4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:53.155800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:53.190408 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:53.191072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:53.191363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:53.191636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:53.192325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:53.192631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:53.194113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:53.203637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 427/839] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:39:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:53.205189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:53.280898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ef079-3566-4fb6-9397-a4c5719210eb None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:53.306911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:53.326661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:53.327592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:53.327882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:53.328159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:53.328843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:53.329150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:53.331044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:53.341384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 413/840] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:53.341546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7aa66-d441-4bdd-96b9-65b4d4a0bb44 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:53.343127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:53.381785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a82bac-52a3-417f-b6e3-acc59e87a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:53.382789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82bac-52a3-417f-b6e3-acc59e87a19d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:53.383855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82bac-52a3-417f-b6e3-acc59e87a19d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:53.384502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82bac-52a3-417f-b6e3-acc59e87a19d None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:53.386185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a82bac-52a3-417f-b6e3-acc59e87a19d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:53.386743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a82bac-52a3-417f-b6e3-acc59e87a19d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:53.388414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a82bac-52a3-417f-b6e3-acc59e87a19d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:53.392703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:53.403125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 428/841] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:39:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:53.468368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e02d9c-45aa-4e87-9a61-bc2dc2f7e371 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:53.507592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5475b3-cb06-4179-bad4-5959cc3e42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:53.508274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5475b3-cb06-4179-bad4-5959cc3e42ed None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:53.508561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5475b3-cb06-4179-bad4-5959cc3e42ed None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:53.508841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5475b3-cb06-4179-bad4-5959cc3e42ed None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:53.509537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5475b3-cb06-4179-bad4-5959cc3e42ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:53.509845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5475b3-cb06-4179-bad4-5959cc3e42ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:53.511269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5475b3-cb06-4179-bad4-5959cc3e42ed None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:53.517012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 414/842] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:54.506047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820cac0-cd7a-4975-abda-e010f054ba76 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:54.506604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820cac0-cd7a-4975-abda-e010f054ba76 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:54.506604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820cac0-cd7a-4975-abda-e010f054ba76 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:54.508776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 429/843] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:54.514499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006ca12-784b-44bf-b451-8c4c780253a9 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:54.515033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006ca12-784b-44bf-b451-8c4c780253a9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:54.515110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006ca12-784b-44bf-b451-8c4c780253a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:54.535208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b006ca12-784b-44bf-b451-8c4c780253a9 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:54.536404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b006ca12-784b-44bf-b451-8c4c780253a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:54.607483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 415/844] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:39:54.630518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820cac0-cd7a-4975-abda-e010f054ba76 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:54.744284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820cac0-cd7a-4975-abda-e010f054ba76 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:54.779046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe77a7-ecf0-4720-abf3-1770060ddf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:54.779631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe77a7-ecf0-4720-abf3-1770060ddf3a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:54.779919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe77a7-ecf0-4720-abf3-1770060ddf3a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:54.780199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe77a7-ecf0-4720-abf3-1770060ddf3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:54.791494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe77a7-ecf0-4720-abf3-1770060ddf3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-c1fe77a7-ecf0-4720-abf3-1770060ddf3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:54.796379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:54.797293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:54.798313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 430/845] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:54.803424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006ca12-784b-44bf-b451-8c4c780253a9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:54.839181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:54.913629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006ca12-784b-44bf-b451-8c4c780253a9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:54.950046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e823c40-5566-4d39-aa90-a25c4688b37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:54.950672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823c40-5566-4d39-aa90-a25c4688b37a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:54.950977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823c40-5566-4d39-aa90-a25c4688b37a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:54.951259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823c40-5566-4d39-aa90-a25c4688b37a None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:54.951979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823c40-5566-4d39-aa90-a25c4688b37a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:54.952287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823c40-5566-4d39-aa90-a25c4688b37a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:54.953660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823c40-5566-4d39-aa90-a25c4688b37a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:54.962508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 416/846] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:54.968012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe77a7-ecf0-4720-abf3-1770060ddf3a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:54.970998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:54.982100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87114ffd-65af-4488-bcf5-91e556008968 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:54.982393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87114ffd-65af-4488-bcf5-91e556008968 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:54.982678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87114ffd-65af-4488-bcf5-91e556008968 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:54.984275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 417/847] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:39:54.989600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f988-b2bd-48d1-989a-dac3fa105d57 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:54.989884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f988-b2bd-48d1-989a-dac3fa105d57 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:54.990157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f988-b2bd-48d1-989a-dac3fa105d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.009465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a7c0f988-b2bd-48d1-989a-dac3fa105d57 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:55.010652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a7c0f988-b2bd-48d1-989a-dac3fa105d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:55.085353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe77a7-ecf0-4720-abf3-1770060ddf3a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.096319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 418/848] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:55.119271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0f988-b2bd-48d1-989a-dac3fa105d57 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.132656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.133424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.133774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.134160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.148131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:55.149334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:55.149962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:55.166470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:55.167441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:55.168342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:55.168342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:55.168342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:55.168342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:55.168342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 431/849] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:55.174364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.230523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0f988-b2bd-48d1-989a-dac3fa105d57 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.252388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:55.271998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c814ae7-084b-4afc-ad18-6a10dab204a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.272770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c814ae7-084b-4afc-ad18-6a10dab204a9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.273125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c814ae7-084b-4afc-ad18-6a10dab204a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.273510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c814ae7-084b-4afc-ad18-6a10dab204a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.285498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c814ae7-084b-4afc-ad18-6a10dab204a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-4c814ae7-084b-4afc-ad18-6a10dab204a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:39:55.291464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:55.292398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:39:55.293269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:55.297608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 419/850] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:39:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:55.298642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c814ae7-084b-4afc-ad18-6a10dab204a9 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.317610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864592-fb74-4e57-8e6f-5e0b9dd1194f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.365885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.367091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.368012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.368753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.369915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:55.370429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:55.372743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:55.394553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 432/851] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:55.396472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.400818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:55.418764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c814ae7-084b-4afc-ad18-6a10dab204a9 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.456350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.457081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.457524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.457900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.458635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:55.459062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:55.461478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:55.475140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 420/852] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:39:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:55.476291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.530542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33395-2387-4155-aa6a-9321880ccf21 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.546661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:55.569210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46a45a-44f7-4b74-a10c-cda7c77f2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.570078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46a45a-44f7-4b74-a10c-cda7c77f2f8f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.570569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46a45a-44f7-4b74-a10c-cda7c77f2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.571071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46a45a-44f7-4b74-a10c-cda7c77f2f8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.578510 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46a45a-44f7-4b74-a10c-cda7c77f2f8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:55.579996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46a45a-44f7-4b74-a10c-cda7c77f2f8f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:55.583075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0ab4-e888-4100-8b5e-66f9f1bb0388 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-9b46a45a-44f7-4b74-a10c-cda7c77f2f8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:55.592367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:55.593317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:55.594305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 433/853] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:39:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:55.594885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3b7e9-2888-4d8e-ad9a-fc5618843408 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.594974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3b7e9-2888-4d8e-ad9a-fc5618843408 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.595252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3b7e9-2888-4d8e-ad9a-fc5618843408 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.596799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 434/854] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:55.597920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135de7c-1df9-403e-a2e7-50c293b7a1f0 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.598334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135de7c-1df9-403e-a2e7-50c293b7a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.598446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135de7c-1df9-403e-a2e7-50c293b7a1f0 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.599668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 435/855] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:55.600498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135de7c-1df9-403e-a2e7-50c293b7a1f0 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.623928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5228a7-3145-40d2-9517-e8cf574231a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.624511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5228a7-3145-40d2-9517-e8cf574231a9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.624791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5228a7-3145-40d2-9517-e8cf574231a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.625069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5228a7-3145-40d2-9517-e8cf574231a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.635616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5228a7-3145-40d2-9517-e8cf574231a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:55.637061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5228a7-3145-40d2-9517-e8cf574231a9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:55.645195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-ca5228a7-3145-40d2-9517-e8cf574231a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:55.652711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:55.653623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:55.654522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:55.654522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:55.654522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:55.654522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:55.658546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 421/856] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:55.659895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c2d0-c080-466a-a978-b78a96c46d72 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.660182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c2d0-c080-466a-a978-b78a96c46d72 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.660465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c2d0-c080-466a-a978-b78a96c46d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.678157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e496c2d0-c080-466a-a978-b78a96c46d72 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:55.679398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e496c2d0-c080-466a-a978-b78a96c46d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:55.702333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135de7c-1df9-403e-a2e7-50c293b7a1f0 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.736519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.737140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.737434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.737709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.738499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:55.738811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:55.740280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:55.745128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 422/857] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:55.746346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411f2d9-37f3-4e50-99e9-736394fc0674 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.746633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411f2d9-37f3-4e50-99e9-736394fc0674 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.746907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411f2d9-37f3-4e50-99e9-736394fc0674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.763837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 436/858] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jul 26 07:39:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:55.763837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.765174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3411f2d9-37f3-4e50-99e9-736394fc0674 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:55.766364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3411f2d9-37f3-4e50-99e9-736394fc0674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:55.796222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:55.832019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 423/859] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:55.832846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411f2d9-37f3-4e50-99e9-736394fc0674 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.873409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cf12d-446e-495d-9d21-26d696e75b5d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.891035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:55.907575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.908192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.908475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.908749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:55.909437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:55.909744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:55.911183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:55.922246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 437/860] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:55.923215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:55.935306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411f2d9-37f3-4e50-99e9-736394fc0674 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:55.968837 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb075d34-73e2-4524-a7ba-ca30ea3890ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:55.969447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075d34-73e2-4524-a7ba-ca30ea3890ab None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:55.969727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075d34-73e2-4524-a7ba-ca30ea3890ab None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:55.969998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075d34-73e2-4524-a7ba-ca30ea3890ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.011275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:56.020448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2480bcc-64eb-4e5e-b974-ef497dd18d02 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:56.036640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb075d34-73e2-4524-a7ba-ca30ea3890ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.038088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb075d34-73e2-4524-a7ba-ca30ea3890ab None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.052909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e398-8977-4538-bd34-3824f3f72a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:56.053518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e398-8977-4538-bd34-3824f3f72a37 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:56.053798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e398-8977-4538-bd34-3824f3f72a37 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:56.054070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33e398-8977-4538-bd34-3824f3f72a37 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.055285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33e398-8977-4538-bd34-3824f3f72a37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.056630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33e398-8977-4538-bd34-3824f3f72a37 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.071683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 438/861] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:39:55 2022] POST /identity/v3/services => generated 269 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:56.072455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e398-8977-4538-bd34-3824f3f72a37 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:56.118873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:56.145810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 424/862] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:39:56.146671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb075d34-73e2-4524-a7ba-ca30ea3890ab None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:56.192362 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33e398-8977-4538-bd34-3824f3f72a37 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:56.230901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4f105-7f42-4ff5-8bba-2ca29d74ca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:56.231634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f105-7f42-4ff5-8bba-2ca29d74ca2a None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:56.232415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f105-7f42-4ff5-8bba-2ca29d74ca2a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:56.232415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f105-7f42-4ff5-8bba-2ca29d74ca2a None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.233118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4f105-7f42-4ff5-8bba-2ca29d74ca2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.234588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4f105-7f42-4ff5-8bba-2ca29d74ca2a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.252444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 439/863] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:39:56 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:39:56.253174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4f105-7f42-4ff5-8bba-2ca29d74ca2a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:56.264671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb075d34-73e2-4524-a7ba-ca30ea3890ab None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:56.265750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:56.322943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:56.323787 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:56.324340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:56.324710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.336192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.338616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:39:56.355346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:56.356530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:39:56.357548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:56.359925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 425/864] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:39:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:56.365935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:56.389511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4f105-7f42-4ff5-8bba-2ca29d74ca2a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:56.391681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:56.442538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:56.443937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:56.444631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:56.445055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.458838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.460344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:56.477574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:56.478518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:56.479454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:56.479454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:56.479454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:56.479454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:56.479682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 440/865] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:56.486093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:56.497296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a35e47-2082-4f62-a926-89c007144713 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:56.540505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:56.541430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:56.541855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:56.542335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.543417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:56.544049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.545696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.559175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:56.569713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 426/866] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jul 26 07:39:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:56.575134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:56.603790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817aa05-b311-488c-b05a-b9748431db3f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:56.641411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:56.642238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:56.642589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:56.642950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.643724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:56.644720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.645866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.659997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 441/867] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:56.666860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:56.675515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:56.704502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50707e28-b0cc-4d26-a31e-30f22d8173a8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:56.743302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6c524-d9b3-40b8-91e3-b992f671da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:56.743933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c524-d9b3-40b8-91e3-b992f671da6e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:56.744218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c524-d9b3-40b8-91e3-b992f671da6e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:56.744496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c524-d9b3-40b8-91e3-b992f671da6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.814059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992150-67b4-42a0-b858-731a7d4a6f1f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:56.818535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6c524-d9b3-40b8-91e3-b992f671da6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.819512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6c524-d9b3-40b8-91e3-b992f671da6e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.842321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:56.862180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:56.862835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:56.863152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:56.863430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:56.870535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:56.872026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:56.883788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:56.884689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:56.885600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:56.885600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:56.885600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:56.885600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:56.885600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:56.885600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:56.885600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:56.885600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:56.889757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 442/868] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:56.891078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:56.918119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:56.950801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 427/869] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:39:56 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:39:56.952181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6c524-d9b3-40b8-91e3-b992f671da6e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:57.013720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bea6d-1f61-4afc-99ff-8f67fb9fc55b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:57.049844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:57.050520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:57.050808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:57.051155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:57.051910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:57.052220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:57.053670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:57.071464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 443/870] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:57.072898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:57.080040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6c524-d9b3-40b8-91e3-b992f671da6e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:57.118118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:57.125537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:57.126270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:57.126628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:57.127009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:57.138042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:57.139657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:39:57.156066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:57.156959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:57.157822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:39:57.157822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:39:57.157822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:39:57.157822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:57.161713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 428/871] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:57.163295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:57.193141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:57.197415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037c7b7-24b9-47e9-bc2f-98eeec76a932 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:57.243747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:57.244949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:57.245376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:57.246681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:57.247654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=de1dd35abd2e4db0bda795191eeee287) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:57.248112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:57.249856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:57.259237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 444/872] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:57 2022] GET /identity/v3/role_assignments?user.id=de1dd35abd2e4db0bda795191eeee287&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=53894f3146884908ba6dd3e118397fb3 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:57.286958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51bfc2-8a81-41a4-89c3-10c2fd515ab5 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:57.326459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:57.327130 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:57.327411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:57.327683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:57.328398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:57.328705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:57.330110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:57.345055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 429/873] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:57.350421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:57.461613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0812-d393-43ca-83de-4fafb2ab8865 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:57.465148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:57.501121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:57.501814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:57.502098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:57.502372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:57.509952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:57.511420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:39:57.524187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:57.525164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:57.526063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 445/874] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:57.531154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:57.621824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:57.637067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3e0a2-fcfa-4360-af6c-9bced3b45109 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:57.673159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189e212-cbbf-43e5-b8d0-27d79d705e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:57.673782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e212-cbbf-43e5-b8d0-27d79d705e5a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:57.674060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e212-cbbf-43e5-b8d0-27d79d705e5a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:57.674335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e212-cbbf-43e5-b8d0-27d79d705e5a None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:57.675119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189e212-cbbf-43e5-b8d0-27d79d705e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:57.675428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189e212-cbbf-43e5-b8d0-27d79d705e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:57.676858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189e212-cbbf-43e5-b8d0-27d79d705e5a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:57.688949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 430/875] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:57.694818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:57.799963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87453ae-a8fc-473b-b4ae-3b51be7c97a3 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:57.835243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50517a7-496c-424f-b714-9f77c9e0ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:57.836780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50517a7-496c-424f-b714-9f77c9e0ad19 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:57.837262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50517a7-496c-424f-b714-9f77c9e0ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:57.837741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50517a7-496c-424f-b714-9f77c9e0ad19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:57.838748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50517a7-496c-424f-b714-9f77c9e0ad19 None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=a6d078f161bc415ca00848947b9cd947) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:57.839296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50517a7-496c-424f-b714-9f77c9e0ad19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:57.840961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50517a7-496c-424f-b714-9f77c9e0ad19 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:57.848012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 446/876] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:39:57 2022] GET /identity/v3/role_assignments?user.id=a6d078f161bc415ca00848947b9cd947&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:58.162128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1e0f-c027-4974-b386-3b844ca88bac None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.162506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1e0f-c027-4974-b386-3b844ca88bac None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.162712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1e0f-c027-4974-b386-3b844ca88bac None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.164366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 431/877] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:58.169441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374e3c2-21a5-489f-aa44-87656f60f85c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.169733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374e3c2-21a5-489f-aa44-87656f60f85c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.170013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374e3c2-21a5-489f-aa44-87656f60f85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.188201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4374e3c2-21a5-489f-aa44-87656f60f85c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:58.189402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4374e3c2-21a5-489f-aa44-87656f60f85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:58.213669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:58.259791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 447/878] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:39:58.281848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba1e0f-c027-4974-b386-3b844ca88bac None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:58.387651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba1e0f-c027-4974-b386-3b844ca88bac None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:58.426785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:58.427394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.427673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.427947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.428584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:58.430585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:58.432510 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4315e-c2de-485f-8986-8dc41d75bec1 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.432799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4315e-c2de-485f-8986-8dc41d75bec1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.433078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4315e-c2de-485f-8986-8dc41d75bec1 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.434641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 448/879] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:58.439354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a931815-ac8d-4f00-a15d-c4f5e3855a7a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.439641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a931815-ac8d-4f00-a15d-c4f5e3855a7a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.439917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a931815-ac8d-4f00-a15d-c4f5e3855a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:58.441244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:58.442147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:39:58.442992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:58.449524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 432/880] 10.222.0.46 () {56 vars in 1132 bytes} [Tue Jul 26 07:39:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:58.450592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:58.464857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:58.469155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-6a931815-ac8d-4f00-a15d-c4f5e3855a7a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:58.475928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6a931815-ac8d-4f00-a15d-c4f5e3855a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:58.564905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 449/881] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:39:58.569990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da43f9-e818-4bc9-803e-87137645ee28 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:58.588240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a931815-ac8d-4f00-a15d-c4f5e3855a7a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:58.609737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:58.611102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.611858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.612318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.613351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:58.614153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:58.616169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:58.623574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 433/882] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:39:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:58.629166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:58.685951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:58.700222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a931815-ac8d-4f00-a15d-c4f5e3855a7a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:58.710169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:58.737579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:58.738222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.738550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.738830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.739551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d89d5-0dde-4307-b9e5-4fab32c0654d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:58.739683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:58.740979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:58.752103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:58.753989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:39:58.756214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:39:58.760811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 450/883] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:39:58.761697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:58.784770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:58.785743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.786220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.786745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.787649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:58.788162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:58.789839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:58.795433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 434/884] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:39:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:58.801174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:58.875138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fcb64-2dbb-4e76-9b62-9e7c2c9b5fb7 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:58.907345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13712ff6-9c84-4f26-a044-9693f975d562 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:58.911434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:58.911703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.912042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.912401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.913092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:58.913393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:58.914811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:58.923274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 451/885] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:58.925715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:58.944521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:58.948056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:58.949160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:58.949700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:58.950183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:58.951238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] RBAC: Adding query filter params (interface=public, service_id=b3ddfb10059547368656fd7b788ebdc8, region_id=RegionOne) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:58.951782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:58.953418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:58.966838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 435/886] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jul 26 07:39:58 2022] GET /identity/v3/endpoints?service_id=b3ddfb10059547368656fd7b788ebdc8&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:58.968041 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:58.971043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:59.036865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5abb-a558-41ca-ac21-b99eea8b2a50 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:59.076792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:59.077304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.077585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.077857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.078542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:59.078836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:59.080233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:59.081133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942826a-2377-4b75-b94f-e39cd53bf1b6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:59.090806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 452/887] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:39:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:39:59.091505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:59.116826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc7ede-54a0-4c1f-acd4-7e770af3760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:59.118342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc7ede-54a0-4c1f-acd4-7e770af3760c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.118879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc7ede-54a0-4c1f-acd4-7e770af3760c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.119376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc7ede-54a0-4c1f-acd4-7e770af3760c None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.120271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc7ede-54a0-4c1f-acd4-7e770af3760c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:59.121882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc7ede-54a0-4c1f-acd4-7e770af3760c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:59.135089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 436/888] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:39:58 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:39:59.182293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:59.205775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ff51a-c2a6-437c-8afa-288fa3307b0c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:59.244005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917b16-dc57-4330-9fdd-3efaff7ec786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:59.244641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917b16-dc57-4330-9fdd-3efaff7ec786 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.244921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917b16-dc57-4330-9fdd-3efaff7ec786 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.245195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917b16-dc57-4330-9fdd-3efaff7ec786 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.245958 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1917b16-dc57-4330-9fdd-3efaff7ec786 None admin] RBAC: Adding query filter params (interface=public, service_id=50ea23e7701f44299177c75b9b5bdd1f, region_id=RegionOne) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:59.246266 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1917b16-dc57-4330-9fdd-3efaff7ec786 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:59.247675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1917b16-dc57-4330-9fdd-3efaff7ec786 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:59.254011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 453/889] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jul 26 07:39:59 2022] GET /identity/v3/endpoints?service_id=50ea23e7701f44299177c75b9b5bdd1f&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:59.260270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc7ede-54a0-4c1f-acd4-7e770af3760c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:59.331509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:59.369227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc7ede-54a0-4c1f-acd4-7e770af3760c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:59.380550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba595d21-d6be-4b13-83e3-e7e4236a30b0 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.380849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba595d21-d6be-4b13-83e3-e7e4236a30b0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.381113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba595d21-d6be-4b13-83e3-e7e4236a30b0 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.382770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 454/890] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:39:59.388126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715f77-5faa-4d6c-b003-6c2907c11e74 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.388415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715f77-5faa-4d6c-b003-6c2907c11e74 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.388698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715f77-5faa-4d6c-b003-6c2907c11e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.408432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8a715f77-5faa-4d6c-b003-6c2907c11e74 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:39:59.409617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8a715f77-5faa-4d6c-b003-6c2907c11e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:39:59.414032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbda64-7c44-4d56-afc4-9ab481356ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:59.414877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbda64-7c44-4d56-afc4-9ab481356ae9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.415449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbda64-7c44-4d56-afc4-9ab481356ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.415905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbda64-7c44-4d56-afc4-9ab481356ae9 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.416800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbda64-7c44-4d56-afc4-9ab481356ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:59.418885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbda64-7c44-4d56-afc4-9ab481356ae9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:59.427869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 437/891] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:39:59 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:39:59.492975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 455/892] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:39:59.514972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbda64-7c44-4d56-afc4-9ab481356ae9 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:59.627757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbda64-7c44-4d56-afc4-9ab481356ae9 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:59.666794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:59.673654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:59.674565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.675143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.675633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.676478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:59.678049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:39:59.688758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:39:59.689752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:39:59.690590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:39:59.693366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 438/893] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:39:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:39:59.704026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715f77-5faa-4d6c-b003-6c2907c11e74 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:59.784154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:39:59.810884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715f77-5faa-4d6c-b003-6c2907c11e74 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:59.846674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0cda0-f915-4579-900d-0defe6a48414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:39:59.847783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cda0-f915-4579-900d-0defe6a48414 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.847995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cda0-f915-4579-900d-0defe6a48414 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.850982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cda0-f915-4579-900d-0defe6a48414 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.850982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0cda0-f915-4579-900d-0defe6a48414 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:39:59.850982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0cda0-f915-4579-900d-0defe6a48414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:39:59.850982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0cda0-f915-4579-900d-0defe6a48414 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:39:59.856498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 456/894] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:39:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:39:59.862816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:39:59.970323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3f0de-8fc1-43d5-9e6e-726b640b0157 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:39:59.980533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5594d-59a8-4f69-9bbd-bde85698811c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.980840 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5594d-59a8-4f69-9bbd-bde85698811c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.981118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5594d-59a8-4f69-9bbd-bde85698811c None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:39:59.983335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 457/895] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:39:59.991194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8fb5-2bb8-4cf4-bf71-0b9debc075e6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:39:59.991588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8fb5-2bb8-4cf4-bf71-0b9debc075e6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:39:59.992358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8fb5-2bb8-4cf4-bf71-0b9debc075e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:00.009640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:00.010266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:00.010554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:00.010834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:00.011557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:00.011867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:00.013243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:00.014817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5cdd8fb5-2bb8-4cf4-bf71-0b9debc075e6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:00.016895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5cdd8fb5-2bb8-4cf4-bf71-0b9debc075e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:00.018276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 439/896] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:39:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:00.107183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 458/897] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:39:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:00.125844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:00.191868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:00.237364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952f475-61d3-4626-8f78-3e43e70d09a1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:00.273949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd284a7-d79b-4881-a6c2-f06b3914e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:00.274889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd284a7-d79b-4881-a6c2-f06b3914e0e8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:00.275420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd284a7-d79b-4881-a6c2-f06b3914e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:00.275872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd284a7-d79b-4881-a6c2-f06b3914e0e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:00.286692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd284a7-d79b-4881-a6c2-f06b3914e0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-edd284a7-d79b-4881-a6c2-f06b3914e0e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:00.292547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:00.293496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:00.294327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:00.299086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 440/898] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jul 26 07:40:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:00.302990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd8fb5-2bb8-4cf4-bf71-0b9debc075e6 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:00.373317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:00.408775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd8fb5-2bb8-4cf4-bf71-0b9debc075e6 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:00.442957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:00.443588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:00.443869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:00.444146 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:00.444874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:00.445688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:00.447101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:00.455809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 459/899] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jul 26 07:40:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:00.462088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd284a7-d79b-4881-a6c2-f06b3914e0e8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:00.573953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd284a7-d79b-4881-a6c2-f06b3914e0e8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:00.592983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:00.612605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:00.613257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:00.613544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:00.613824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:00.626446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:00.628062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:00.643620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:00.644840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:00.646172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:00.646172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:00.646172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:00.646172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:00.646172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 441/900] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:00.652516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:00.761332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecd025-1e77-4500-b509-a92adcf0c598 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:00.795331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:00.800189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:00.800817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:00.801430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:00.801709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:00.802405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:00.802708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:00.804119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:00.817436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 460/901] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:00.823565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:00.945949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92434f7-2c2d-46f3-a1bc-d54534c0feb8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:00.981359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:00.982008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:00.982337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:00.982612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:00.990417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:00.991901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:40:01.004166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:01.005123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:01.006316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 442/902] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:40:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:01.013125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:01.116394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8796fb-39e1-4cf1-b558-f85e387f09de None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:01.154375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877d16f-e253-43f0-a134-990cfb1b220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:01.155032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d16f-e253-43f0-a134-990cfb1b220f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.155316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d16f-e253-43f0-a134-990cfb1b220f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.155593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d16f-e253-43f0-a134-990cfb1b220f None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.156387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877d16f-e253-43f0-a134-990cfb1b220f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:01.156697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877d16f-e253-43f0-a134-990cfb1b220f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:01.158129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877d16f-e253-43f0-a134-990cfb1b220f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:01.176383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 461/903] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jul 26 07:40:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:01.184008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:01.217157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:01.223219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce358de-0695-4b03-83b0-2a1889a7ea99 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.223525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce358de-0695-4b03-83b0-2a1889a7ea99 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.223805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce358de-0695-4b03-83b0-2a1889a7ea99 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.226335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 462/904] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:40:01.231781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90d0b-2c4a-4f08-9a1e-4fbacb32ab9b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.232063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90d0b-2c4a-4f08-9a1e-4fbacb32ab9b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.232338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90d0b-2c4a-4f08-9a1e-4fbacb32ab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.257142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9cc90d0b-2c4a-4f08-9a1e-4fbacb32ab9b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:01.258527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9cc90d0b-2c4a-4f08-9a1e-4fbacb32ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:01.298406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b02bb4-98cd-4b87-aa85-e5abc82b7f56 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:01.315039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:01.345453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d12d5-ef36-4e89-917d-ef89b47a073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:01.350978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 463/905] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:01.351197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d12d5-ef36-4e89-917d-ef89b47a073c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.351197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d12d5-ef36-4e89-917d-ef89b47a073c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.351197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d12d5-ef36-4e89-917d-ef89b47a073c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.369552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc90d0b-2c4a-4f08-9a1e-4fbacb32ab9b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:01.435110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d12d5-ef36-4e89-917d-ef89b47a073c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:01.437649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d12d5-ef36-4e89-917d-ef89b47a073c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:01.475666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:01.492722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc90d0b-2c4a-4f08-9a1e-4fbacb32ab9b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:01.532365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7262513-b114-42e7-b049-a5ce0ee7b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:01.533532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262513-b114-42e7-b049-a5ce0ee7b33b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.534068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262513-b114-42e7-b049-a5ce0ee7b33b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.534639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262513-b114-42e7-b049-a5ce0ee7b33b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.535489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262513-b114-42e7-b049-a5ce0ee7b33b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:01.537331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262513-b114-42e7-b049-a5ce0ee7b33b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-f7262513-b114-42e7-b049-a5ce0ee7b33b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:01.547963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:01.549153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 07:40:01.549987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:01.557200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 464/906] 10.222.0.46 () {56 vars in 1132 bytes} [Tue Jul 26 07:40:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:01.557200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592226-ca73-46e3-9b89-41afbedf7c36 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.557200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592226-ca73-46e3-9b89-41afbedf7c36 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.557200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592226-ca73-46e3-9b89-41afbedf7c36 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.557539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 443/907] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:01 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:01.558293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 465/908] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:01.559036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d12d5-ef36-4e89-917d-ef89b47a073c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:01.562693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592226-ca73-46e3-9b89-41afbedf7c36 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:01.611736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:01.663010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d12d5-ef36-4e89-917d-ef89b47a073c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:01.674901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592226-ca73-46e3-9b89-41afbedf7c36 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:01.694875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:01.702084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d59824-e73e-4ac3-aa2f-4ad5ea284144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:01.702706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d59824-e73e-4ac3-aa2f-4ad5ea284144 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.703022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d59824-e73e-4ac3-aa2f-4ad5ea284144 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.703296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d59824-e73e-4ac3-aa2f-4ad5ea284144 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.704074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d59824-e73e-4ac3-aa2f-4ad5ea284144 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:01.704344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d59824-e73e-4ac3-aa2f-4ad5ea284144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:01.705615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d59824-e73e-4ac3-aa2f-4ad5ea284144 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:01.711610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 444/909] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:40:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:01.714821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:01.715497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.716001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.716106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.717095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a42bf-2a98-47e0-90b8-f2096fc2a9e1 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.717382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a42bf-2a98-47e0-90b8-f2096fc2a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.717660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a42bf-2a98-47e0-90b8-f2096fc2a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.727561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:01.728982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:01.735757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-220a42bf-2a98-47e0-90b8-f2096fc2a9e1 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:01.736852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-220a42bf-2a98-47e0-90b8-f2096fc2a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:01.745354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:01.746448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:01.747560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:01.747560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:01.747560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:01.747560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:01.752851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 466/910] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:01.752851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:01.810529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 445/911] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:01.811506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a42bf-2a98-47e0-90b8-f2096fc2a9e1 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:01.871134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:01.879236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebdc60-e27d-4b3e-b4b4-696b4c84c634 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:01.918651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83316057-79ed-4784-9010-b2111c153774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:01.919323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83316057-79ed-4784-9010-b2111c153774 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.919608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83316057-79ed-4784-9010-b2111c153774 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.919882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83316057-79ed-4784-9010-b2111c153774 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.920459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a42bf-2a98-47e0-90b8-f2096fc2a9e1 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:01.920559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83316057-79ed-4784-9010-b2111c153774 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:01.920860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83316057-79ed-4784-9010-b2111c153774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:01.922512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83316057-79ed-4784-9010-b2111c153774 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:01.934210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 467/912] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:40:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:01.934210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83316057-79ed-4784-9010-b2111c153774 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:01.946330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:01.962864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:01.963525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:01.963806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:01.964082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:01.964794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:01.965103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:01.966465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:01.982872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 446/913] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:01.982872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:02.047379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83316057-79ed-4784-9010-b2111c153774 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.087119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.088045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.088335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.088615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.089246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.089411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3a884-100f-4d39-9fa5-3fb01d6750ec None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.090620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:02.103533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:02.104531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 07:40:02.105382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:02.106106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 468/914] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:40:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:02.106685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:02.130711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8142b7-9755-42d0-8f46-b0765dda4334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.131368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8142b7-9755-42d0-8f46-b0765dda4334 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.131648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8142b7-9755-42d0-8f46-b0765dda4334 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.131918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8142b7-9755-42d0-8f46-b0765dda4334 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.132625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8142b7-9755-42d0-8f46-b0765dda4334 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.134007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8142b7-9755-42d0-8f46-b0765dda4334 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.136027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:02.156115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 447/915] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:40:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:02.156705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8142b7-9755-42d0-8f46-b0765dda4334 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:02.224723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:02.234727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4728-6eae-487d-89c8-b132c1233ec1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.283434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7149-a2fa-442b-bd6d-ae2b380f2708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.284386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7149-a2fa-442b-bd6d-ae2b380f2708 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.284835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7149-a2fa-442b-bd6d-ae2b380f2708 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.285123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7149-a2fa-442b-bd6d-ae2b380f2708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.293978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7149-a2fa-442b-bd6d-ae2b380f2708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.295498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7149-a2fa-442b-bd6d-ae2b380f2708 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.301916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8142b7-9755-42d0-8f46-b0765dda4334 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-2abb7149-a2fa-442b-bd6d-ae2b380f2708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:40:02.308535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:02.309686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:02.310708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 469/916] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:02.311807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df3196-52d6-401a-a583-b049033e766b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.312096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df3196-52d6-401a-a583-b049033e766b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.312378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df3196-52d6-401a-a583-b049033e766b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.313902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 470/917] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:02.316583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df3196-52d6-401a-a583-b049033e766b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:02.351800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7ae0-7ceb-4a21-b8db-10d2be736e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.352727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7ae0-7ceb-4a21-b8db-10d2be736e97 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.353010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7ae0-7ceb-4a21-b8db-10d2be736e97 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.353518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7ae0-7ceb-4a21-b8db-10d2be736e97 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.353988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7ae0-7ceb-4a21-b8db-10d2be736e97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:02.354289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7ae0-7ceb-4a21-b8db-10d2be736e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.355702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7ae0-7ceb-4a21-b8db-10d2be736e97 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.363117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 448/918] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:40:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:02.364127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee50db-7d12-4160-a6d8-488400d29259 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.364885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee50db-7d12-4160-a6d8-488400d29259 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.365182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee50db-7d12-4160-a6d8-488400d29259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.389418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b1ee50db-7d12-4160-a6d8-488400d29259 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:02.390694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b1ee50db-7d12-4160-a6d8-488400d29259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:02.407832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:02.433342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df3196-52d6-401a-a583-b049033e766b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.465425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 449/919] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:02.466237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee50db-7d12-4160-a6d8-488400d29259 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:02.474618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.475493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.475925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.476860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.478218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:02.478717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.481039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.499410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 471/920] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:02.501203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:02.503191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:02.578758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee50db-7d12-4160-a6d8-488400d29259 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.599940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e75f2-42c9-44db-9ee4-2d3e740a48f0 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.616250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.617690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.618125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.618495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.619318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:02.619723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.621314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.631400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 450/921] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jul 26 07:40:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:02.631400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:02.639172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d215f66-b518-4726-9138-436626d12115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.639875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d215f66-b518-4726-9138-436626d12115 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.640255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d215f66-b518-4726-9138-436626d12115 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.640622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d215f66-b518-4726-9138-436626d12115 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.641409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d215f66-b518-4726-9138-436626d12115 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.642898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d215f66-b518-4726-9138-436626d12115 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.652717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:02.667468 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 472/922] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:40:02 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:02.668517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d215f66-b518-4726-9138-436626d12115 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:02.754057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:02.758921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122af8f9-3f01-4190-8192-83217b172bfe None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.809910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b315d-6d38-4e51-b04e-29153f2bc904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.810669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b315d-6d38-4e51-b04e-29153f2bc904 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.811036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b315d-6d38-4e51-b04e-29153f2bc904 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.811389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b315d-6d38-4e51-b04e-29153f2bc904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.812260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b315d-6d38-4e51-b04e-29153f2bc904 None admin] RBAC: Adding query filter params (role.id=ab6850dbce74442d9ddfebc5c9d14617, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=a6d078f161bc415ca00848947b9cd947) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:02.812576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b315d-6d38-4e51-b04e-29153f2bc904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.814041 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b315d-6d38-4e51-b04e-29153f2bc904 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.816429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d215f66-b518-4726-9138-436626d12115 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:02.820899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 451/923] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:02 2022] GET /identity/v3/role_assignments?user.id=a6d078f161bc415ca00848947b9cd947&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=ab6850dbce74442d9ddfebc5c9d14617 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:02.868475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f520607-2613-48dc-b785-0bce4034f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:02.869121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f520607-2613-48dc-b785-0bce4034f450 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:02.869405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f520607-2613-48dc-b785-0bce4034f450 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:02.869681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f520607-2613-48dc-b785-0bce4034f450 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:02.870406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f520607-2613-48dc-b785-0bce4034f450 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:02.871830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f520607-2613-48dc-b785-0bce4034f450 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:02.899257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 473/924] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:40:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:04.212453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373a97-6ee1-42eb-bbc6-a397fd6379f3 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.212970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373a97-6ee1-42eb-bbc6-a397fd6379f3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.213083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373a97-6ee1-42eb-bbc6-a397fd6379f3 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.214548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 452/925] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:04.219830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f29bb-1571-4bc0-8d78-edeb5cdaa284 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.220213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f29bb-1571-4bc0-8d78-edeb5cdaa284 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.220390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f29bb-1571-4bc0-8d78-edeb5cdaa284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.239234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f13f29bb-1571-4bc0-8d78-edeb5cdaa284 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:04.240412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f13f29bb-1571-4bc0-8d78-edeb5cdaa284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:04.292417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:04.318281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 474/926] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:04.340282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d373a97-6ee1-42eb-bbc6-a397fd6379f3 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:04.450662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d373a97-6ee1-42eb-bbc6-a397fd6379f3 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:04.487754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:04.488746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.489242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.489714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] PATH_INFO: `/v3/services/compute` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.490557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:04.492192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:04.501613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:04.502614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:04.503477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:04.506201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 453/927] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:04.512341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f29bb-1571-4bc0-8d78-edeb5cdaa284 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:04.617816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f29bb-1571-4bc0-8d78-edeb5cdaa284 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:04.654087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad894ba-2931-4d96-a6f2-eebf3cd02da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:04.655126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad894ba-2931-4d96-a6f2-eebf3cd02da7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.655613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad894ba-2931-4d96-a6f2-eebf3cd02da7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.656109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad894ba-2931-4d96-a6f2-eebf3cd02da7 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.657003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad894ba-2931-4d96-a6f2-eebf3cd02da7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:04.657506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad894ba-2931-4d96-a6f2-eebf3cd02da7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:04.659107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad894ba-2931-4d96-a6f2-eebf3cd02da7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:04.665128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 475/928] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:40:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:04.672030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:04.699150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:04.784706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e28a8-ebd0-48b1-b1eb-e5bfa4a48d6e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:04.785711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcfd4-7acf-4ebb-afb6-240ef3d5a24b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.785995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcfd4-7acf-4ebb-afb6-240ef3d5a24b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.786267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcfd4-7acf-4ebb-afb6-240ef3d5a24b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.788011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 476/929] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:04.793045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdb93b-7233-4a1f-9cc8-4c84d436a38a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.793338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdb93b-7233-4a1f-9cc8-4c84d436a38a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.793611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdb93b-7233-4a1f-9cc8-4c84d436a38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.812396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-e5cdb93b-7233-4a1f-9cc8-4c84d436a38a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:04.814350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e5cdb93b-7233-4a1f-9cc8-4c84d436a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:04.828051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f8f77-3198-4c5c-b3ad-1fe7b5971e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:04.829090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8f77-3198-4c5c-b3ad-1fe7b5971e3c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.829379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8f77-3198-4c5c-b3ad-1fe7b5971e3c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.829802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f8f77-3198-4c5c-b3ad-1fe7b5971e3c None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.830624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8f77-3198-4c5c-b3ad-1fe7b5971e3c None admin] RBAC: Adding query filter params (type=compute) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:04.830959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8f77-3198-4c5c-b3ad-1fe7b5971e3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:04.833086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f8f77-3198-4c5c-b3ad-1fe7b5971e3c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:04.840039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 454/930] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:40:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:04.841942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9d5e-3c91-46bf-8dcd-feda2260491e None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.842437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9d5e-3c91-46bf-8dcd-feda2260491e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.842739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9d5e-3c91-46bf-8dcd-feda2260491e None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.848191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 455/931] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:04.851599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321f8c-ab60-48a6-84ab-a190c2da074c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:04.851887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321f8c-ab60-48a6-84ab-a190c2da074c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:04.852165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321f8c-ab60-48a6-84ab-a190c2da074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:04.871796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-96321f8c-ab60-48a6-84ab-a190c2da074c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:04.873026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-96321f8c-ab60-48a6-84ab-a190c2da074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:04.903887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 477/932] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:04.910999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:04.927381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdb93b-7233-4a1f-9cc8-4c84d436a38a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:04.959063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 456/933] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:04.981227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321f8c-ab60-48a6-84ab-a190c2da074c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.001250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:05.052582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdb93b-7233-4a1f-9cc8-4c84d436a38a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.092313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321f8c-ab60-48a6-84ab-a190c2da074c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.092619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b5fe6-07a0-4b20-8734-36d1a6660091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.093180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5fe6-07a0-4b20-8734-36d1a6660091 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.093465 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5fe6-07a0-4b20-8734-36d1a6660091 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.093745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5fe6-07a0-4b20-8734-36d1a6660091 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.094374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b5fe6-07a0-4b20-8734-36d1a6660091 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.095776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b5fe6-07a0-4b20-8734-36d1a6660091 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-c25b5fe6-07a0-4b20-8734-36d1a6660091 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:05.104888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:05.105865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.106717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 478/934] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:40:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:05.107566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48b2c9-73f2-4051-943b-ad1d55cc9af0 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.107566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48b2c9-73f2-4051-943b-ad1d55cc9af0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.108255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48b2c9-73f2-4051-943b-ad1d55cc9af0 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.109211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 479/935] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:05.112299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48b2c9-73f2-4051-943b-ad1d55cc9af0 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.133453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c37b-4f49-4ece-b6c5-6fb7c07dd37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.134106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c37b-4f49-4ece-b6c5-6fb7c07dd37b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.134385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c37b-4f49-4ece-b6c5-6fb7c07dd37b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.134658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c37b-4f49-4ece-b6c5-6fb7c07dd37b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.145727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3c37b-4f49-4ece-b6c5-6fb7c07dd37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-b7c3c37b-4f49-4ece-b6c5-6fb7c07dd37b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:05.150748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:05.151857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:05.152722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 457/936] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jul 26 07:40:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:05.153396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61087a5-fbd5-4f37-9ac8-c7d8ae32baba None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.153660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61087a5-fbd5-4f37-9ac8-c7d8ae32baba None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.153935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61087a5-fbd5-4f37-9ac8-c7d8ae32baba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.162015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:05.172289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e61087a5-fbd5-4f37-9ac8-c7d8ae32baba None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:05.173495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e61087a5-fbd5-4f37-9ac8-c7d8ae32baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:05.225980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48b2c9-73f2-4051-943b-ad1d55cc9af0 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.262951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 458/937] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:05.262951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61087a5-fbd5-4f37-9ac8-c7d8ae32baba None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.263570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.263570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.263570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.263570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.263886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:05.263886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.264607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.270051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 480/938] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:05.275395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.278029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:05.381767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61087a5-fbd5-4f37-9ac8-c7d8ae32baba None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.383682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919060a-eb15-4140-a314-8af419ebf731 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.385327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:05.420576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.421144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.421288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.421461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.421729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.421822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.422030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.422300 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.422391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:05.422696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.423042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:05.423349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.424117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.424700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.429137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 481/939] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:05.431759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.434527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 459/940] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:05.435721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.504221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:05.538472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570052-643a-44dd-bf0b-b3313e22d026 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.547145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39a145-e539-4f7a-9e8d-4ebba39291b8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.574822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.575469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.575751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.576024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.576780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] RBAC: Adding query filter params (interface=public, service_id=31684aaea1604603a7867ff1609eb0e7, region_id=RegionOne) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:05.577102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.578473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.583930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 460/941] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/endpoints?service_id=31684aaea1604603a7867ff1609eb0e7&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:05.584730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.590132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.590839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.591143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.591414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.592088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.593512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.596169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING keystone.server.flask.common [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 07:40:05.615565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.sql.core [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 07:40:05.615565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 07:40:05.615565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [parameters: {'id': '2b482be68a454fb995ee3b923c22c68b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 07:40:05.615565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91860) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b482be68a454fb995ee3b923c22c68b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b482be68a454fb995ee3b923c22c68b. Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:40:05.632750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application result.read() Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 07:40:05.633576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application yield resource Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise self.value Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application session.commit() Jul 26 07:40:05.634529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self.session.flush() Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application compat.raise_( Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 07:40:05.635989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 07:40:05.636935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application result.read() Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:40:05.637719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [parameters: {'id': '2b482be68a454fb995ee3b923c22c68b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.639713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:05.641707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b482be68a454fb995ee3b923c22c68b. Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 482/942] 10.222.0.46 () {60 vars in 1140 bytes} [Tue Jul 26 07:40:05 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:05.643940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.670233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:05.697116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8fc1-089c-43e6-a40d-89b3a94ce771 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.727663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:05.733034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.733677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.733963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.734238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.745013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.746593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.753611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f61de-7f96-4e8f-9b1b-7a2dd503363a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:05.761432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:05.762471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:05.763851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:05.763851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:05.763851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:05.763851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:05.767261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 461/943] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:05.767932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.793212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557e80f-f580-486d-856a-9e67828b3918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.793918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557e80f-f580-486d-856a-9e67828b3918 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.794265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557e80f-f580-486d-856a-9e67828b3918 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.794610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557e80f-f580-486d-856a-9e67828b3918 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.795471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557e80f-f580-486d-856a-9e67828b3918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.797118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557e80f-f580-486d-856a-9e67828b3918 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.807358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 483/944] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:40:05.809577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557e80f-f580-486d-856a-9e67828b3918 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.884570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15578e-8f62-4f05-8a37-f6eabd81dfd7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.920939 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:05.938041 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.938756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557e80f-f580-486d-856a-9e67828b3918 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:05.939276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.939720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.940154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.951084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.953539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:40:05.973540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:05.974750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:05.975943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:40:05.975943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:40:05.975943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:40:05.975943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:40:05.975943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:40:05.975943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:40:05.975943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:05.975943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:05.977556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 462/945] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:05.982512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:05.983691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:05.984723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:05.984723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:05.985056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:05.985561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:05.985868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:05.989066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:06.001457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 484/946] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:06.007063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:06.040030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:06.103382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3371-ed39-49df-9287-fbd671ab6f0b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:06.128154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9d60d-facc-4ee3-aca4-e8401831c2a2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:06.144580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:06.145719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:06.146149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:06.146859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:06.148907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:06.149492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:06.152049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:06.170855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:06.172201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:06.172612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:06.172984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:06.176923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 463/947] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:40:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:06.183925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:06.185683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:40:06.199915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:06.201137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:40:06.202301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:06.204638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 485/948] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:40:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:06.214116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:06.334118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551d1b8-61e8-4ff2-8061-1ee8c8d6afa9 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:06.337445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:06.375834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:06.376500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:06.376781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:06.377054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:06.377859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:06.378162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:06.379702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:06.401416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 464/949] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jul 26 07:40:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:06.407144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:06.418028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:06.516719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e05f8-d035-4b80-b22c-87e7be5fe0b4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:06.553179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:06.554079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:06.555076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:06.555522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:06.567186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:06.568861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:06.584268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:06.585364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:06.586531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:06.586531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:06.586531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:06.586531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:06.588392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 486/950] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:06.593827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:06.697843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4322603-152e-4a16-b927-96cf0a539167 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:06.732099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335fa38-253b-4e85-b0ff-963164db67bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:06.732721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fa38-253b-4e85-b0ff-963164db67bc None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:06.733004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fa38-253b-4e85-b0ff-963164db67bc None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:06.733283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fa38-253b-4e85-b0ff-963164db67bc None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:06.733975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335fa38-253b-4e85-b0ff-963164db67bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:06.734281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335fa38-253b-4e85-b0ff-963164db67bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:06.735754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335fa38-253b-4e85-b0ff-963164db67bc None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:06.748190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 465/951] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:06.753841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:06.817111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:06.864655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0e4dc-4f2d-444c-a2f9-9037876ee0ee None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:06.900086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:06.900735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:06.901016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:06.901289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:06.908295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:06.909812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:40:06.921793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:06.922713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:06.923805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 487/952] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:06.930133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3fc22-20fd-4436-862a-32191712009c None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:06.930426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3fc22-20fd-4436-862a-32191712009c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:06.930710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3fc22-20fd-4436-862a-32191712009c None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:06.931883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:06.932305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 466/953] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:06.938252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81299-7dbb-45ea-aac6-de573daefb4c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:06.938536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81299-7dbb-45ea-aac6-de573daefb4c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:06.938817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81299-7dbb-45ea-aac6-de573daefb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:06.961772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-98f81299-7dbb-45ea-aac6-de573daefb4c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:06.963420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-98f81299-7dbb-45ea-aac6-de573daefb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:06.985665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:07.044895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 467/954] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:07.058387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3787e4-28dc-4cfb-96c6-821057306611 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:07.071534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81299-7dbb-45ea-aac6-de573daefb4c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:07.082107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:07.113442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:07.113442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:07.113442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:07.113442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:07.113896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:07.113896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:07.113896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:07.133298 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 488/955] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:07.134348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:07.187081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81299-7dbb-45ea-aac6-de573daefb4c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:07.229261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970a209-059d-43d5-a5e4-c63ae1f2ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:07.230098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970a209-059d-43d5-a5e4-c63ae1f2ce56 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:07.230474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970a209-059d-43d5-a5e4-c63ae1f2ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:07.231211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970a209-059d-43d5-a5e4-c63ae1f2ce56 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:07.232288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970a209-059d-43d5-a5e4-c63ae1f2ce56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:07.233937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970a209-059d-43d5-a5e4-c63ae1f2ce56 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:07.252080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7a093-b996-4461-9061-0f47869bd4f9 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:07.253893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 468/956] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:40:07 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:40:07.304268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba573fb-4010-457e-986f-8d2a129904d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:07.305601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba573fb-4010-457e-986f-8d2a129904d6 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:07.305933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba573fb-4010-457e-986f-8d2a129904d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:07.306210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba573fb-4010-457e-986f-8d2a129904d6 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/a6d078f161bc415ca00848947b9cd947/roles/ab6850dbce74442d9ddfebc5c9d14617` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:07.308570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba573fb-4010-457e-986f-8d2a129904d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=a6d078f161bc415ca00848947b9cd947, role_id=ab6850dbce74442d9ddfebc5c9d14617)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:07.310158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba573fb-4010-457e-986f-8d2a129904d6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:07.331319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 489/957] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:40:07 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/a6d078f161bc415ca00848947b9cd947/roles/ab6850dbce74442d9ddfebc5c9d14617 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:40:07.943603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bc1b8-bdd0-4854-875f-b90e4f8ce90b None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:07.944319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bc1b8-bdd0-4854-875f-b90e4f8ce90b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:07.944319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bc1b8-bdd0-4854-875f-b90e4f8ce90b None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:07.946317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 469/958] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:07.951652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba801e-15a4-4ded-86e8-c464819534f6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:07.952161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba801e-15a4-4ded-86e8-c464819534f6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:07.952323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba801e-15a4-4ded-86e8-c464819534f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:07.971813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-0cba801e-15a4-4ded-86e8-c464819534f6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:07.973334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0cba801e-15a4-4ded-86e8-c464819534f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:08.002082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:08.047470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 490/959] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:08.070134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bc1b8-bdd0-4854-875f-b90e4f8ce90b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:08.086549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:08.175138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bc1b8-bdd0-4854-875f-b90e4f8ce90b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:08.210000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6787a-40aa-4633-b08b-5bc418947d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:08.210668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6787a-40aa-4633-b08b-5bc418947d56 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:08.210973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6787a-40aa-4633-b08b-5bc418947d56 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:08.211252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6787a-40aa-4633-b08b-5bc418947d56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:08.211880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6787a-40aa-4633-b08b-5bc418947d56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:08.213304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6787a-40aa-4633-b08b-5bc418947d56 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-5fa6787a-40aa-4633-b08b-5bc418947d56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:08.222381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:08.224708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.225801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 470/960] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:40:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:08.229696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba801e-15a4-4ded-86e8-c464819534f6 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:08.314754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f78976-db83-4df3-8e95-321e6f34b489 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:08.315127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f78976-db83-4df3-8e95-321e6f34b489 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:08.315359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f78976-db83-4df3-8e95-321e6f34b489 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:08.316954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 471/961] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:08.322452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa4675-60bd-4bc2-8a8c-65d82c7d327b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:08.322735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa4675-60bd-4bc2-8a8c-65d82c7d327b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:08.323047 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa4675-60bd-4bc2-8a8c-65d82c7d327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:08.334948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba801e-15a4-4ded-86e8-c464819534f6 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:08.341152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-46fa4675-60bd-4bc2-8a8c-65d82c7d327b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:08.342406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-46fa4675-60bd-4bc2-8a8c-65d82c7d327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:08.379120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:08.379751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:08.380032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:08.380302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:08.380981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:08.381288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:08.383221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:08.390099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 491/962] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:40:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:08.395792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:08.419019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 472/963] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:08.430766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:08.438839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa4675-60bd-4bc2-8a8c-65d82c7d327b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:08.449150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:08.516661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6972a2-8ed2-4779-96d1-63f199784f09 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:08.553455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa4675-60bd-4bc2-8a8c-65d82c7d327b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:08.555621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:08.556512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:08.556797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:08.557173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:08.557864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:08.558172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:08.559761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:08.570026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 492/964] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:40:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:08.571337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:08.591339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:08.592040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:08.592386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:08.592728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:08.593464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:08.595074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:08.597956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING keystone.server.flask.common [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 07:40:08.611863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.sql.core [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 07:40:08.611863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 07:40:08.611863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [parameters: {'user_id': '966bf1f3eb124707b6259288d802352f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 07:40:08.611863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91861) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result.read() Jul 26 07:40:08.620135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:40:08.621996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application yield resource Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application next(self.gen) Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise self.value Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application session.commit() Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 07:40:08.624281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.session.flush() Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application compat.raise_( Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 07:40:08.626400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 07:40:08.635685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application conn.query(q) Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application result.read() Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 07:40:08.637450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [parameters: {'user_id': '966bf1f3eb124707b6259288d802352f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:08.639222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 07:40:08.640877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 07:40:08.651318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 07:40:08.651318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 07:40:08.651318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 07:40:08.651318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 07:40:08.651318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 07:40:08.651318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.651318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 473/965] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jul 26 07:40:08 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:08.651318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:08.668865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:08.678380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7ff5-e6a0-4e54-9c0a-df5467a1baf8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:08.707813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:08.716358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc17b4-b9b2-45c1-9a96-6f560814c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:08.716989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc17b4-b9b2-45c1-9a96-6f560814c122 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:08.717322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc17b4-b9b2-45c1-9a96-6f560814c122 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:08.717602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc17b4-b9b2-45c1-9a96-6f560814c122 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:08.718993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc17b4-b9b2-45c1-9a96-6f560814c122 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:08.720371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc17b4-b9b2-45c1-9a96-6f560814c122 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:08.747611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 493/966] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:40:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:40:08.759624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd5b3-75bf-4ffa-8960-4026735f827f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:08.809172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9800e-0c2c-4814-8208-1b83ce423a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:08.809838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9800e-0c2c-4814-8208-1b83ce423a1f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:08.810117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9800e-0c2c-4814-8208-1b83ce423a1f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:08.810390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9800e-0c2c-4814-8208-1b83ce423a1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:08.819298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9800e-0c2c-4814-8208-1b83ce423a1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:08.820952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9800e-0c2c-4814-8208-1b83ce423a1f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-d6d9800e-0c2c-4814-8208-1b83ce423a1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:40:08.849792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:08.852557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:08.854760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 474/967] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:40:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:08.862954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc17b4-b9b2-45c1-9a96-6f560814c122 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:08.968004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc17b4-b9b2-45c1-9a96-6f560814c122 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:09.005702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffb7bb-83c1-4f2a-b241-8415349e73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:09.006330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffb7bb-83c1-4f2a-b241-8415349e73df None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.006609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffb7bb-83c1-4f2a-b241-8415349e73df None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.006881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffb7bb-83c1-4f2a-b241-8415349e73df None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.007713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffb7bb-83c1-4f2a-b241-8415349e73df None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:09.008016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffb7bb-83c1-4f2a-b241-8415349e73df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:09.009445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffb7bb-83c1-4f2a-b241-8415349e73df None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:09.048056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 494/968] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jul 26 07:40:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:09.355161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4167-7e1e-4701-a691-5cc4c383538f None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.355837 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4167-7e1e-4701-a691-5cc4c383538f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.355837 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4167-7e1e-4701-a691-5cc4c383538f None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.357009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 475/969] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:09.362259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d8402-96a9-48e6-8039-7dd118aa7e17 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.362554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d8402-96a9-48e6-8039-7dd118aa7e17 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.362835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d8402-96a9-48e6-8039-7dd118aa7e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.375400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:09.382138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9f9d8402-96a9-48e6-8039-7dd118aa7e17 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:09.384377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9f9d8402-96a9-48e6-8039-7dd118aa7e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:09.403574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa955-d489-4aea-9007-0c3e64fc7536 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.403864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa955-d489-4aea-9007-0c3e64fc7536 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.404144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa955-d489-4aea-9007-0c3e64fc7536 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.405477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 476/970] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:09.410079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9968-eef5-4d88-81f7-8646c86cb185 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.410362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9968-eef5-4d88-81f7-8646c86cb185 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.410638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9968-eef5-4d88-81f7-8646c86cb185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.428152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-4cbc9968-eef5-4d88-81f7-8646c86cb185 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:09.429692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4cbc9968-eef5-4d88-81f7-8646c86cb185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:09.458095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 495/971] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:09.480959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d8402-96a9-48e6-8039-7dd118aa7e17 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:09.504299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 477/972] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:09.528187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9968-eef5-4d88-81f7-8646c86cb185 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:09.585748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:09.590341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d8402-96a9-48e6-8039-7dd118aa7e17 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:09.627115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:09.627988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.628431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.628850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] PATH_INFO: `/v3/services/compute` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.629618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:09.631190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:09.632163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9968-eef5-4d88-81f7-8646c86cb185 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:09.634662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:09.643213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:09.644570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:09.645545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:09.648276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 496/973] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:09.654120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:09.671970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576db6f-92c2-4d42-9388-a17173d93fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:09.672618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576db6f-92c2-4d42-9388-a17173d93fe7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.672897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576db6f-92c2-4d42-9388-a17173d93fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.673188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576db6f-92c2-4d42-9388-a17173d93fe7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.684094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576db6f-92c2-4d42-9388-a17173d93fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-3576db6f-92c2-4d42-9388-a17173d93fe7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:09.688959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:09.689928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:09.690764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 478/974] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jul 26 07:40:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:09.696686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576db6f-92c2-4d42-9388-a17173d93fe7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:09.768502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318f461-6d98-464c-bf4d-e69c7e7360ee None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:09.802809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:09.803608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.803987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.804880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.805738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:09.805879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576db6f-92c2-4d42-9388-a17173d93fe7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:09.806323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:09.807856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:09.820717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 497/975] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:40:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:09.821260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:09.821778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:09.850221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:09.850476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:09.853494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:09.853494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:09.853494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:09.853494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:09.853815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:09.867908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 479/976] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jul 26 07:40:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:09.869176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:09.914894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:09.967484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391ae35-e012-46a5-8f15-8c927efd9995 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:09.987916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc8de9-0d16-4ac9-aa67-c1af37214766 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:10.024580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:10.025457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.025908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.026331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.026512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:10.027286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.027572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.027846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.028846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:10.029160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:10.030532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:10.039227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 498/977] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:40:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:10.042668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:10.044348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:10.045789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:10.063382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:10.064658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:10.065545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:10.065545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:10.065545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:10.065545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:10.065545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 480/978] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:10.071499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:10.108527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:10.173219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e49f51-1242-4ab3-883a-ef85b6784386 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:10.190009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3898d3-4c99-4fb6-a272-705e13d42d3f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:10.200697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:10.208858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:10.209482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.209764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.210041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.210826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] RBAC: Adding query filter params (interface=public, service_id=cd9f914b74014154a439fbb219b0a949, region_id=RegionOne) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:10.211161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:10.212545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:10.217774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 499/979] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jul 26 07:40:10 2022] GET /identity/v3/endpoints?service_id=cd9f914b74014154a439fbb219b0a949&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:10.223156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:10.227219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:10.227844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.228125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.228396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.229087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:10.229389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:10.230747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:10.244671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 481/980] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:10.250025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:10.331982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c245342-6502-4850-a835-bdc0be9b10c2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:10.340382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:10.355737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ceb13-901c-434b-911c-12b8db1cf4c7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:10.367963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99b251-1cad-49e5-a228-b2c4f212a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:10.368588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99b251-1cad-49e5-a228-b2c4f212a68e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.368871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99b251-1cad-49e5-a228-b2c4f212a68e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.369148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99b251-1cad-49e5-a228-b2c4f212a68e None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.369838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99b251-1cad-49e5-a228-b2c4f212a68e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:10.371201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99b251-1cad-49e5-a228-b2c4f212a68e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:10.378560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 500/981] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:40:10 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:40:10.391168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:10.391840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.392120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.392392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.401618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:10.403140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:40:10.416861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:10.417878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:10.424194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 482/982] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:40:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:10.424819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99b251-1cad-49e5-a228-b2c4f212a68e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:10.488205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:10.538156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99b251-1cad-49e5-a228-b2c4f212a68e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:10.577182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805bc92-dda4-4891-819d-ef1765752f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:10.577804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805bc92-dda4-4891-819d-ef1765752f6f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.578083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805bc92-dda4-4891-819d-ef1765752f6f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.578353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805bc92-dda4-4891-819d-ef1765752f6f None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.579167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805bc92-dda4-4891-819d-ef1765752f6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:10.579473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805bc92-dda4-4891-819d-ef1765752f6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:10.580887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805bc92-dda4-4891-819d-ef1765752f6f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:10.598957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 501/983] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jul 26 07:40:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:10.605113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:10.708555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327101-81be-4aa3-bbe8-0425549ee977 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:10.742225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c31e2-6e40-4127-bebb-8be9d8c223a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:10.742844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c31e2-6e40-4127-bebb-8be9d8c223a0 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.743178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c31e2-6e40-4127-bebb-8be9d8c223a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.743456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c31e2-6e40-4127-bebb-8be9d8c223a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.761360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:10.811967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c31e2-6e40-4127-bebb-8be9d8c223a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:10.813413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c31e2-6e40-4127-bebb-8be9d8c223a0 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:10.843809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3979-9be6-49ed-ad1f-e5d886401375 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.844443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3979-9be6-49ed-ad1f-e5d886401375 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.844921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3979-9be6-49ed-ad1f-e5d886401375 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.848356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 502/984] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:40:10.854907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c578e-4be5-4843-bab7-a1dedde047c8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:10.855232 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c578e-4be5-4843-bab7-a1dedde047c8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:10.855514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c578e-4be5-4843-bab7-a1dedde047c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:10.874039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8a4c578e-4be5-4843-bab7-a1dedde047c8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:10.875708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8a4c578e-4be5-4843-bab7-a1dedde047c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:10.928084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 483/985] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:10 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:40:10.933515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c31e2-6e40-4127-bebb-8be9d8c223a0 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:10.956230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 503/986] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:10.975413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c578e-4be5-4843-bab7-a1dedde047c8 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:10.983458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:11.023681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:11.040095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c31e2-6e40-4127-bebb-8be9d8c223a0 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.076204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.077089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.077376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.077710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.081774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c578e-4be5-4843-bab7-a1dedde047c8 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.088884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.090331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:11.105499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:11.106604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:11.107727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:11.107727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:11.107727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:11.107727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:11.111258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 484/987] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:11.112277 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:11.121668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.122325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.122607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.122879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.123532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.124903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:11.135053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:11.136053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:11.136929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 504/988] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:40:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:11.141985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:11.218106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:11.221663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee5f5f-a226-4cab-87e1-e51235a84b2a None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.254662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c72396-fd7a-4e0e-999c-8ad0681e1e72 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.255751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.256393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.256676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.256956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.258192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:11.258499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.259897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.264572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:11.271815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 485/989] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:11.277442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:11.294020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.294788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.295102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.295653 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.296334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:11.296641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.298389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.309528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 505/990] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:40:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:11.311115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:11.380257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb5718-f7aa-40b1-811f-833c3448d01b None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.417508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7b10-d760-4f01-b0e1-2e366b8fa912 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.419208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.420612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.420901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.421177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.429955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.431959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:40:11.447598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:11.448504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:11.449382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 486/991] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:11.453352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.453984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.454269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.454547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.454748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:11.455273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:11.455583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.456979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.462162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 506/992] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:40:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:11.468250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:11.478418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:11.510139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:11.567291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427f04a-a758-4842-ba67-750d1b7c276e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.578862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89664460-f9bc-487a-aaa3-e2a208ef83b9 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.604009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.604630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.604913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.605179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.605927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:11.606237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.607713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.613549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.614836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.615295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.615729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.617615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] RBAC: Adding query filter params (interface=admin, service_id=31684aaea1604603a7867ff1609eb0e7, region_id=RegionOne) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:11.617933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.619297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.620041 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 487/993] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:11.628831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 507/994] 10.222.0.46 () {56 vars in 1249 bytes} [Tue Jul 26 07:40:11 2022] GET /identity/v3/endpoints?service_id=31684aaea1604603a7867ff1609eb0e7&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:11.628982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:11.629772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:11.708404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:11.729891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:11.732371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91389118-c46b-4e99-aca3-3a7a3a6d8e4d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.733070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789525ef-2b71-4ea3-b584-31c7f8a025bc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:11.768491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11f7dc-7f47-4012-bafe-1479724726d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.768931 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44977296-72d5-4d90-ab4c-76696fb976a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:11.769301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11f7dc-7f47-4012-bafe-1479724726d0 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.769562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11f7dc-7f47-4012-bafe-1479724726d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.769801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44977296-72d5-4d90-ab4c-76696fb976a1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:11.769898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11f7dc-7f47-4012-bafe-1479724726d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.770080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44977296-72d5-4d90-ab4c-76696fb976a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:11.770348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44977296-72d5-4d90-ab4c-76696fb976a1 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:11.770605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11f7dc-7f47-4012-bafe-1479724726d0 None admin] RBAC: Adding query filter params (role.id=ab6850dbce74442d9ddfebc5c9d14617, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=a6d078f161bc415ca00848947b9cd947) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:11.770916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11f7dc-7f47-4012-bafe-1479724726d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.771040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44977296-72d5-4d90-ab4c-76696fb976a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:11.772367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44977296-72d5-4d90-ab4c-76696fb976a1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.772469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11f7dc-7f47-4012-bafe-1479724726d0 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:11.787252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 508/995] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:40:11 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:40:11.787473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 488/996] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:11 2022] GET /identity/v3/role_assignments?user.id=a6d078f161bc415ca00848947b9cd947&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=ab6850dbce74442d9ddfebc5c9d14617 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:12.385036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2bb71-298d-4113-8c98-914ba6aac24e None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:12.385555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2bb71-298d-4113-8c98-914ba6aac24e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:12.385658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2bb71-298d-4113-8c98-914ba6aac24e None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:12.387134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 509/997] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:12.392027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93e9f-fcac-4b91-b5a6-9c444981aabb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:12.392464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93e9f-fcac-4b91-b5a6-9c444981aabb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:12.392624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93e9f-fcac-4b91-b5a6-9c444981aabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:12.411549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-29a93e9f-fcac-4b91-b5a6-9c444981aabb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:12.412742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-29a93e9f-fcac-4b91-b5a6-9c444981aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:12.483761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 489/998] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:12.505806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2bb71-298d-4113-8c98-914ba6aac24e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:12.609430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2bb71-298d-4113-8c98-914ba6aac24e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:12.642885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:12.643491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:12.643776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:12.644316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:12.644947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:12.646315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:12.655174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:12.656168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 07:40:12.657029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:12.659246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 510/999] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:12.662476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93e9f-fcac-4b91-b5a6-9c444981aabb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:12.738990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:12.765905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93e9f-fcac-4b91-b5a6-9c444981aabb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:12.803367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:12.803992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:12.804783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:12.805064 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:12.805742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:12.806046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:12.807443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:12.816717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 490/1000] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:40:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:12.818190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:12.855199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:12.935846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ef2c5-781b-4251-838a-370e16d46329 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:12.970217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6120ba-fabc-4edd-8601-91a029f5bb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:12.970841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6120ba-fabc-4edd-8601-91a029f5bb85 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:12.971223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6120ba-fabc-4edd-8601-91a029f5bb85 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:12.971502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6120ba-fabc-4edd-8601-91a029f5bb85 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:12.972178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6120ba-fabc-4edd-8601-91a029f5bb85 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:12.972485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6120ba-fabc-4edd-8601-91a029f5bb85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:12.973851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6120ba-fabc-4edd-8601-91a029f5bb85 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:12.979381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 511/1001] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jul 26 07:40:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:12.984993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:13.084904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931e271-4861-4e2e-b5bc-3bb07ec6a0b4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:13.119179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cbfb6-0e4b-4d05-9f54-e69d0ee943e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:13.119796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cbfb6-0e4b-4d05-9f54-e69d0ee943e5 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:13.120081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cbfb6-0e4b-4d05-9f54-e69d0ee943e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:13.120361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cbfb6-0e4b-4d05-9f54-e69d0ee943e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:13.121085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cbfb6-0e4b-4d05-9f54-e69d0ee943e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:13.122452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cbfb6-0e4b-4d05-9f54-e69d0ee943e5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:13.130854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:13.149880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 491/1002] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:40:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:13.778478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebec4-a64d-4f74-84ef-b5d448bc072c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:13.779038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebec4-a64d-4f74-84ef-b5d448bc072c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:13.779038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebec4-a64d-4f74-84ef-b5d448bc072c None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:13.780449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 512/1003] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:13.785434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456145c-68bc-4d58-b828-17a40819cc2f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:13.785817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456145c-68bc-4d58-b828-17a40819cc2f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:13.785976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456145c-68bc-4d58-b828-17a40819cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:13.800212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695fbe5-7120-44a2-a7a8-2fa8b3639d04 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:13.800498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695fbe5-7120-44a2-a7a8-2fa8b3639d04 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:13.800765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695fbe5-7120-44a2-a7a8-2fa8b3639d04 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:13.802083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 513/1004] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:40:13.804885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0456145c-68bc-4d58-b828-17a40819cc2f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:13.806126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0456145c-68bc-4d58-b828-17a40819cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:13.806921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bcbb9-6f4b-41d0-9f28-6e49701288c8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:13.807229 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bcbb9-6f4b-41d0-9f28-6e49701288c8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:13.807502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bcbb9-6f4b-41d0-9f28-6e49701288c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:13.826324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-fe9bcbb9-6f4b-41d0-9f28-6e49701288c8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:13.827518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fe9bcbb9-6f4b-41d0-9f28-6e49701288c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:13.891672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 492/1005] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:13 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:13.908116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 514/1006] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:13 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:13.914525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456145c-68bc-4d58-b828-17a40819cc2f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:13.929085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bcbb9-6f4b-41d0-9f28-6e49701288c8 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:13.956501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:14.024537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456145c-68bc-4d58-b828-17a40819cc2f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:14.033367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bcbb9-6f4b-41d0-9f28-6e49701288c8 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:14.045662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:14.064605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:14.065255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:14.065541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:14.065823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:14.066462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:14.067906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:14.071395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:14.072243 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:14.072666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:14.073081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] PATH_INFO: `/v3/services/image` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:14.073843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:14.075375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:14.077625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:14.083659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:14.084606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 493/1007] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jul 26 07:40:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:14.085425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:14.091334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:14.092290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:14.093127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:14.095079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 515/1008] 10.222.0.46 () {56 vars in 1105 bytes} [Tue Jul 26 07:40:13 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:14.098021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:14.187129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:14.195834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331d38-631e-474b-ac7a-03b3d5cd8bd6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:14.203119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280607cd-5ea4-4285-a2a3-944b6b41327a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:14.231788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:14.232404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:14.232683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:14.233102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:14.233678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:14.233916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:14.235299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:14.238012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:14.238632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:14.238916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:14.239225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:14.239932 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] RBAC: Adding query filter params (name=image) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:14.240245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:14.241605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:14.245479 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 494/1009] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:40:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:14.246154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:14.252087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 516/1010] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:14.252859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:14.308428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:14.365384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c0647-bed0-4579-b965-6e2f08aced00 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:14.367358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f4e1-bc28-4362-833d-2c5a2c0ea1da None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:14.401445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:14.402064 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:14.402341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:14.402614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:14.403323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:14.403628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:14.404997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:14.407885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eae28-9b95-4508-a9c3-03fa4026cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:14.408608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae28-9b95-4508-a9c3-03fa4026cf3c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:14.408890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae28-9b95-4508-a9c3-03fa4026cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:14.409161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae28-9b95-4508-a9c3-03fa4026cf3c None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:14.409832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eae28-9b95-4508-a9c3-03fa4026cf3c None admin] RBAC: Adding query filter params (type=image) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:14.414558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eae28-9b95-4508-a9c3-03fa4026cf3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:14.414689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 495/1011] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jul 26 07:40:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:14.414801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eae28-9b95-4508-a9c3-03fa4026cf3c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:14.415539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:14.423329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 517/1012] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:14.525398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70c4fa-984b-444b-9cd6-a51820c708c0 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:14.539748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:14.563956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68074ff-35b4-402d-98eb-76c8e5722ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:14.564501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68074ff-35b4-402d-98eb-76c8e5722ca3 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:14.564784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68074ff-35b4-402d-98eb-76c8e5722ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:14.565056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68074ff-35b4-402d-98eb-76c8e5722ca3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:14.565767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68074ff-35b4-402d-98eb-76c8e5722ca3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:14.567148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68074ff-35b4-402d-98eb-76c8e5722ca3 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:14.584666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 496/1013] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:40:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:15.238956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e833f2-771d-48b2-bc8a-0685cfa974b9 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:15.239474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e833f2-771d-48b2-bc8a-0685cfa974b9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:15.239578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e833f2-771d-48b2-bc8a-0685cfa974b9 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:15.241029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 518/1014] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:15.246091 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb03ce-99ad-4f2e-96af-146568fa07b7 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:15.246470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb03ce-99ad-4f2e-96af-146568fa07b7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:15.246651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb03ce-99ad-4f2e-96af-146568fa07b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:15.264945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-65cb03ce-99ad-4f2e-96af-146568fa07b7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:15.266131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-65cb03ce-99ad-4f2e-96af-146568fa07b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:15.340942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 497/1015] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:15.363410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e833f2-771d-48b2-bc8a-0685cfa974b9 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:15.379522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:15.466914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e833f2-771d-48b2-bc8a-0685cfa974b9 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:15.499970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e835b7-fc38-4050-8eb6-6130a1b55d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:15.500543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e835b7-fc38-4050-8eb6-6130a1b55d2f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:15.500825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e835b7-fc38-4050-8eb6-6130a1b55d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:15.501100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e835b7-fc38-4050-8eb6-6130a1b55d2f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:15.513562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e835b7-fc38-4050-8eb6-6130a1b55d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-14e835b7-fc38-4050-8eb6-6130a1b55d2f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:15.518666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:15.519929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:15.520784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:15.523955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 519/1016] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jul 26 07:40:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:15.526838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb03ce-99ad-4f2e-96af-146568fa07b7 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:15.624561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:15.629515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb03ce-99ad-4f2e-96af-146568fa07b7 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:15.664406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:15.665330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:15.665793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:15.666247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:15.667189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:15.667689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:15.669230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:15.682449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 498/1017] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jul 26 07:40:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:15.683964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e835b7-fc38-4050-8eb6-6130a1b55d2f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:15.761469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:15.787666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e835b7-fc38-4050-8eb6-6130a1b55d2f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:15.821848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:15.822775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:15.823274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:15.823729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:15.834410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:15.836111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:15.855539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:15.856422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:15.857311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:15.857311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:15.857311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:15.857311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:15.859242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 520/1018] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:15.864554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:15.966438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f8c5-9e2b-4e4e-a3a1-62d41bbd2d48 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:16.000367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:16.000988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.001266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.001539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.002228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:16.002538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:16.003925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:16.020433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 499/1019] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:16.022069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:16.126310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb111d-093a-44b4-9a93-c9b0790009a0 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:16.151214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:16.161027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:16.161678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.161962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.162237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.170659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:16.172133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:40:16.184092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:16.185028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:40:16.186021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:16.189992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 521/1020] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:40:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:16.191433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:16.213972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:16.294629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf739d-6a39-40c0-9a3f-1d2cc33ea07c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:16.328406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908de3b-4604-4768-a867-a10feb7f7614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:16.329020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908de3b-4604-4768-a867-a10feb7f7614 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.329301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908de3b-4604-4768-a867-a10feb7f7614 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.329573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908de3b-4604-4768-a867-a10feb7f7614 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.330358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908de3b-4604-4768-a867-a10feb7f7614 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:16.330664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908de3b-4604-4768-a867-a10feb7f7614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:16.332192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908de3b-4604-4768-a867-a10feb7f7614 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:16.354752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 500/1021] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:40:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:16.356396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:16.402710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22ae9-7d79-4dc6-8e4c-33592c78051a None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.403176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22ae9-7d79-4dc6-8e4c-33592c78051a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.403575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22ae9-7d79-4dc6-8e4c-33592c78051a None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.405246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 501/1022] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:40:16.409862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7997ba-7373-4ee9-80e2-0154faedb2ad None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.410147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7997ba-7373-4ee9-80e2-0154faedb2ad None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.410422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7997ba-7373-4ee9-80e2-0154faedb2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.428443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9d7997ba-7373-4ee9-80e2-0154faedb2ad None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:16.429670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9d7997ba-7373-4ee9-80e2-0154faedb2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:16.465569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d11e1-6867-4662-971e-c159f3e5bfc5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:16.499956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856627-fe87-48e7-bae8-4f04409d26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:16.500580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856627-fe87-48e7-bae8-4f04409d26cb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.500865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856627-fe87-48e7-bae8-4f04409d26cb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.501137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856627-fe87-48e7-bae8-4f04409d26cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.502845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 502/1023] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:16 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:16.525267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7997ba-7373-4ee9-80e2-0154faedb2ad None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:16.535664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:16.560116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:16.574752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca856627-fe87-48e7-bae8-4f04409d26cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:16.576560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca856627-fe87-48e7-bae8-4f04409d26cb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:16.634874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7997ba-7373-4ee9-80e2-0154faedb2ad None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:16.669257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086538a8-8fc9-4be0-b246-7127d260cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:16.669874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086538a8-8fc9-4be0-b246-7127d260cf3c None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.670161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086538a8-8fc9-4be0-b246-7127d260cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.670431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086538a8-8fc9-4be0-b246-7127d260cf3c None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.671139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086538a8-8fc9-4be0-b246-7127d260cf3c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:16.672502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086538a8-8fc9-4be0-b246-7127d260cf3c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:16.675263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 522/1024] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:16 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:16.676803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7458c2-c8a8-459e-a655-b6ff244753b5 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.677570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7458c2-c8a8-459e-a655-b6ff244753b5 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.679518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7458c2-c8a8-459e-a655-b6ff244753b5 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.679518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 523/1025] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:16.685720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7458c2-c8a8-459e-a655-b6ff244753b5 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:16.690111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 503/1026] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:40:16 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:40:16.691279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8f86-8b5b-49c9-8934-4bd968576e69 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.691569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8f86-8b5b-49c9-8934-4bd968576e69 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.691850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b8f86-8b5b-49c9-8934-4bd968576e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.712571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3e8b8f86-8b5b-49c9-8934-4bd968576e69 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:16.713832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3e8b8f86-8b5b-49c9-8934-4bd968576e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:16.785467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:16.797591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:16.799936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 504/1027] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:16.824058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b8f86-8b5b-49c9-8934-4bd968576e69 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:16.824466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7458c2-c8a8-459e-a655-b6ff244753b5 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:16.866390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:16.867203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.867486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.867759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.878991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:16.880487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:16.901895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:16.902876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:16.903837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:16.903837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:16.903837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:16.903837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:16.903837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 524/1028] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:16.909639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:16.941914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b8f86-8b5b-49c9-8934-4bd968576e69 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:16.977869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d78e31-1f75-470b-b160-2835b0df849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:16.978513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78e31-1f75-470b-b160-2835b0df849e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:16.978792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78e31-1f75-470b-b160-2835b0df849e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:16.979110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78e31-1f75-470b-b160-2835b0df849e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:16.980485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d78e31-1f75-470b-b160-2835b0df849e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:16.981718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d78e31-1f75-470b-b160-2835b0df849e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:16.983528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 505/1029] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:16.989013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d78e31-1f75-470b-b160-2835b0df849e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:17.025041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b96dff-51cd-496b-96b7-04a5248a9855 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:17.052352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:17.062782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:17.063698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:17.063980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:17.064250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:17.064944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:17.065276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:17.066655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:17.075542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:17.081274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 525/1030] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:17.086708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:17.095526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d78e31-1f75-470b-b160-2835b0df849e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:17.134267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dafa37-42ce-4497-9421-558f4a732b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:17.134915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dafa37-42ce-4497-9421-558f4a732b27 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:17.135293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dafa37-42ce-4497-9421-558f4a732b27 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:17.135565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dafa37-42ce-4497-9421-558f4a732b27 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:17.136363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dafa37-42ce-4497-9421-558f4a732b27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:17.137898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dafa37-42ce-4497-9421-558f4a732b27 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:17.167344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 506/1031] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:40:16 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:40:17.197868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881f894-2965-4ffd-9daa-4122a75726dc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:17.235066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:17.235735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:17.236018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:17.236305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:17.244712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:17.246197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:40:17.259359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:17.260402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:17.261302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:40:17.261302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:40:17.261302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:40:17.261302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:40:17.261302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:40:17.261302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:40:17.261302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:17.261302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:17.265482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 526/1032] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:17.266774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dafa37-42ce-4497-9421-558f4a732b27 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:17.374391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dafa37-42ce-4497-9421-558f4a732b27 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:17.388946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:17.412204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e8723-e20a-4064-9c13-afa99431dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:17.412845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8723-e20a-4064-9c13-afa99431dbfc None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:17.413132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8723-e20a-4064-9c13-afa99431dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:17.413408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8723-e20a-4064-9c13-afa99431dbfc None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:17.414213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e8723-e20a-4064-9c13-afa99431dbfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:17.414528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e8723-e20a-4064-9c13-afa99431dbfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:17.415986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e8723-e20a-4064-9c13-afa99431dbfc None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:17.430656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 507/1033] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:17.436084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:17.497797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:17.541531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326513a6-664a-4095-b8d6-36279011bb19 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:17.576105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d587cd6-0c7d-448d-a415-8c8a66c71a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:17.576731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587cd6-0c7d-448d-a415-8c8a66c71a04 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:17.577014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587cd6-0c7d-448d-a415-8c8a66c71a04 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:17.577289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587cd6-0c7d-448d-a415-8c8a66c71a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:17.578072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d587cd6-0c7d-448d-a415-8c8a66c71a04 None admin] RBAC: Adding query filter params (role.id=ab6850dbce74442d9ddfebc5c9d14617, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=867e92c5301945a88e5c0ed06c4b7257) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:17.578385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d587cd6-0c7d-448d-a415-8c8a66c71a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:17.579851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d587cd6-0c7d-448d-a415-8c8a66c71a04 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:17.590959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 527/1034] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:17 2022] GET /identity/v3/role_assignments?user.id=867e92c5301945a88e5c0ed06c4b7257&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=ab6850dbce74442d9ddfebc5c9d14617 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:18.714348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0c989-e007-40b2-9a7f-afdfaf366889 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:18.714867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0c989-e007-40b2-9a7f-afdfaf366889 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:18.714973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0c989-e007-40b2-9a7f-afdfaf366889 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:18.716297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 508/1035] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:18.721300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9800a-a58a-4074-a116-97b7b9508350 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:18.721679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9800a-a58a-4074-a116-97b7b9508350 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:18.721843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9800a-a58a-4074-a116-97b7b9508350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:18.740285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b9f9800a-a58a-4074-a116-97b7b9508350 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:18.741473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b9f9800a-a58a-4074-a116-97b7b9508350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:18.807536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 528/1036] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:18.829032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0c989-e007-40b2-9a7f-afdfaf366889 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:18.934874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0c989-e007-40b2-9a7f-afdfaf366889 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:18.968918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:18.969483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:18.969765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:18.970038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] PATH_INFO: `/v3/services/image` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:18.970661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:18.972061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:18.980886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:18.981851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:18.982711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:18.987076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 509/1037] 10.222.0.46 () {56 vars in 1105 bytes} [Tue Jul 26 07:40:18 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:18.988283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9800a-a58a-4074-a116-97b7b9508350 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:19.041455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:19.089676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9800a-a58a-4074-a116-97b7b9508350 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:19.122917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32920d-15c5-4f30-936e-0b351df5bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:19.123560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32920d-15c5-4f30-936e-0b351df5bb44 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.123838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32920d-15c5-4f30-936e-0b351df5bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.124107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32920d-15c5-4f30-936e-0b351df5bb44 None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.124778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32920d-15c5-4f30-936e-0b351df5bb44 None admin] RBAC: Adding query filter params (name=image) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:19.125079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32920d-15c5-4f30-936e-0b351df5bb44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:19.126440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32920d-15c5-4f30-936e-0b351df5bb44 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:19.135090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 529/1038] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:19.137652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:19.177723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:19.217396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772e4e-994a-485c-b325-68e5f4808e53 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.217721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772e4e-994a-485c-b325-68e5f4808e53 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.217952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772e4e-994a-485c-b325-68e5f4808e53 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.219642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 530/1039] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:19.224283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f9f5-f618-448b-8920-5af6b6df0d5e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.224566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f9f5-f618-448b-8920-5af6b6df0d5e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.224835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32f9f5-f618-448b-8920-5af6b6df0d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.242019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd4684-4f3a-4c45-999e-c68975ff7ac4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:19.243689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ce32f9f5-f618-448b-8920-5af6b6df0d5e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:19.244918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ce32f9f5-f618-448b-8920-5af6b6df0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:19.277563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:19.278180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.278460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.278732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.279440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:19.279744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:19.281109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:19.290748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 510/1040] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:19.291750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:19.318096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 531/1041] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:19.342183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f9f5-f618-448b-8920-5af6b6df0d5e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:19.392514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:19.401155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf8b24-b454-4fab-8a10-b464ccee30d4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:19.402803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:19.439764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:19.440385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.440669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.440944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.441857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] RBAC: Adding query filter params (interface=public, service_id=b4c7f471b83643b6a970d2c63cba1b2e, region_id=RegionOne) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:19.442259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:19.443643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:19.448228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32f9f5-f618-448b-8920-5af6b6df0d5e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:19.453877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 511/1042] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jul 26 07:40:19 2022] GET /identity/v3/endpoints?service_id=b4c7f471b83643b6a970d2c63cba1b2e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:19.454848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:19.487567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeb7a5-bb9f-4a14-99d8-5ba830e96245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:19.488141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeb7a5-bb9f-4a14-99d8-5ba830e96245 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.488423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeb7a5-bb9f-4a14-99d8-5ba830e96245 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.488702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbeb7a5-bb9f-4a14-99d8-5ba830e96245 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.489870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbeb7a5-bb9f-4a14-99d8-5ba830e96245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:19.491339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbeb7a5-bb9f-4a14-99d8-5ba830e96245 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:19.494267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 532/1043] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:19.499679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeb7a5-bb9f-4a14-99d8-5ba830e96245 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:19.559351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c7071-9d30-4b7a-966b-5896d064590c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:19.593397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae49fdb-80e6-464b-b128-a0ce85daee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:19.594028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae49fdb-80e6-464b-b128-a0ce85daee0b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.594317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae49fdb-80e6-464b-b128-a0ce85daee0b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.594591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae49fdb-80e6-464b-b128-a0ce85daee0b None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.595283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae49fdb-80e6-464b-b128-a0ce85daee0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:19.596650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae49fdb-80e6-464b-b128-a0ce85daee0b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:19.610434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 512/1044] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:40:19 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:40:19.610633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbeb7a5-bb9f-4a14-99d8-5ba830e96245 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:19.610718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc92a-b2ab-4787-9d7d-54f30fc7b1dd None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.610718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc92a-b2ab-4787-9d7d-54f30fc7b1dd None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.610718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc92a-b2ab-4787-9d7d-54f30fc7b1dd None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.610718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 513/1045] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:19.612083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4153f-6355-4e16-b5f8-6e241558c153 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.612083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4153f-6355-4e16-b5f8-6e241558c153 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.612301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4153f-6355-4e16-b5f8-6e241558c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.626435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:19.631625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-abd4153f-6355-4e16-b5f8-6e241558c153 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:19.633460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-abd4153f-6355-4e16-b5f8-6e241558c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:19.654019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951840ec-7ae1-4c6a-ac5b-f8414476aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:19.654678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951840ec-7ae1-4c6a-ac5b-f8414476aa6f None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.654994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951840ec-7ae1-4c6a-ac5b-f8414476aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.655278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951840ec-7ae1-4c6a-ac5b-f8414476aa6f None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.656604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951840ec-7ae1-4c6a-ac5b-f8414476aa6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:19.658127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951840ec-7ae1-4c6a-ac5b-f8414476aa6f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:19.660529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:19.687276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 533/1046] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:40:19 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:19.719401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 514/1047] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:19.736912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951840ec-7ae1-4c6a-ac5b-f8414476aa6f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:19.857613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951840ec-7ae1-4c6a-ac5b-f8414476aa6f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:19.893307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb784-4fc2-480d-9bbc-a1eaa9e8bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:19.894211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb784-4fc2-480d-9bbc-a1eaa9e8bd2c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:19.895011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb784-4fc2-480d-9bbc-a1eaa9e8bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:19.895011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffb784-4fc2-480d-9bbc-a1eaa9e8bd2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:19.905448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffb784-4fc2-480d-9bbc-a1eaa9e8bd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-82ffb784-4fc2-480d-9bbc-a1eaa9e8bd2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:19.910964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:19.912020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:19.913164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 534/1048] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jul 26 07:40:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:19.918680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4153f-6355-4e16-b5f8-6e241558c153 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:20.024920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4153f-6355-4e16-b5f8-6e241558c153 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:20.060981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:20.061952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:20.062453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:20.062919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:20.063789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:20.064109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:20.065497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:20.075307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 515/1049] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jul 26 07:40:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:20.079859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb784-4fc2-480d-9bbc-a1eaa9e8bd2c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:20.112602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:20.185316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffb784-4fc2-480d-9bbc-a1eaa9e8bd2c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:20.218480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:20.219158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:20.219443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:20.221530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:20.232584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:20.234042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:20.248306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:20.249216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:20.250113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:20.250113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:20.250113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:20.250113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:20.251236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 535/1050] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:20.255123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:20.281188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:20.369151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408d3ae-c984-49fe-9929-b5bda2c9722c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:20.402632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:20.403296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:20.403576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:20.403848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:20.404543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:20.404844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:20.406210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:20.422702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 516/1051] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:20.423869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:20.505550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:20.525968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12636f12-8b15-41e7-af04-cb4d8d8c5255 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:20.560018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:20.560693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:20.560980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:20.561252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:20.569546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:20.571527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:40:20.582556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:20.583538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:20.591304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 536/1052] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:40:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:20.591901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:20.673964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:20.693477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15112ef-2f62-4a96-915c-4cb25faefc87 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:20.731055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:20.731692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:20.732037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:20.732202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:20.733009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:20.733313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:20.734761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:20.756703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 517/1053] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:40:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:20.758379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:20.867540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8810f5b-42d4-4902-8199-992ae0882e1a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:20.903936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:20.904978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:20.905463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:20.905937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:20.916918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:20.918593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:20.920826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:20.935265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:20.936163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:20.937424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:20.937424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:20.937424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:20.937424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:20.937424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 537/1054] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:20.941959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:21.040585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee0ee8-c0e5-40e1-92a5-34831caf3b08 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:21.074718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:21.075367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.075648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.075917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.076609 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:21.076915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:21.078288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:21.086493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:21.090524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 518/1055] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:21.096018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:21.199582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf1db-7258-4a10-b938-74ba0e898f03 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:21.233083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:21.233730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.234013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.234289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.240952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:21.242980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:40:21.254197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:21.255347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:21.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:40:21.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:40:21.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:40:21.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:40:21.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:40:21.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:40:21.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:21.256253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:21.259239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 538/1056] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:21.261577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:21.361706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62d26d-74ce-407b-8a90-b7abfb8761e4 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:21.395701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60534-6f01-4c67-b818-ae6acd70b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:21.396323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60534-6f01-4c67-b818-ae6acd70b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.396607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60534-6f01-4c67-b818-ae6acd70b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.396882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60534-6f01-4c67-b818-ae6acd70b2f6 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.397636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60534-6f01-4c67-b818-ae6acd70b2f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:21.398531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60534-6f01-4c67-b818-ae6acd70b2f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:21.399962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60534-6f01-4c67-b818-ae6acd70b2f6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:21.416851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 519/1057] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:21.418023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:21.473938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:21.519678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b902ae-7494-4589-be5a-b9afbbe6098c None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:21.553564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e357e8-fc71-4ce9-b5c1-1c61cd7420b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:21.554760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e357e8-fc71-4ce9-b5c1-1c61cd7420b0 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.555073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e357e8-fc71-4ce9-b5c1-1c61cd7420b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.555393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e357e8-fc71-4ce9-b5c1-1c61cd7420b0 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/867e92c5301945a88e5c0ed06c4b7257/roles/ab6850dbce74442d9ddfebc5c9d14617` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.557577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e357e8-fc71-4ce9-b5c1-1c61cd7420b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=867e92c5301945a88e5c0ed06c4b7257, role_id=ab6850dbce74442d9ddfebc5c9d14617)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:21.559047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e357e8-fc71-4ce9-b5c1-1c61cd7420b0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:21.573120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 539/1058] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:40:21 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/867e92c5301945a88e5c0ed06c4b7257/roles/ab6850dbce74442d9ddfebc5c9d14617 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:40:21.652218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba090-38b8-4188-90fa-ea623212fd24 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.652567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba090-38b8-4188-90fa-ea623212fd24 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.652781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fba090-38b8-4188-90fa-ea623212fd24 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.654387 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 520/1059] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:21.660057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf52f-ac3a-4fa0-9aa7-a815f590bd71 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.660369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf52f-ac3a-4fa0-9aa7-a815f590bd71 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.660634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf52f-ac3a-4fa0-9aa7-a815f590bd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.680578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-1a5cf52f-ac3a-4fa0-9aa7-a815f590bd71 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:21.681809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1a5cf52f-ac3a-4fa0-9aa7-a815f590bd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:21.760220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 540/1060] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:21.765668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c919d-6647-4883-ae50-688ad2041c8c None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.766120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c919d-6647-4883-ae50-688ad2041c8c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.766202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c919d-6647-4883-ae50-688ad2041c8c None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.767694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 521/1061] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:21.772732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5cf0-0317-473b-bc92-e1b3e93577f5 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.773065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5cf0-0317-473b-bc92-e1b3e93577f5 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.773345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5cf0-0317-473b-bc92-e1b3e93577f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.783069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c919d-6647-4883-ae50-688ad2041c8c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:21.791835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-18fb5cf0-0317-473b-bc92-e1b3e93577f5 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:21.793003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-18fb5cf0-0317-473b-bc92-e1b3e93577f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:21.838616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:21.847938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:21.874415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 541/1062] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:21.892849 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c919d-6647-4883-ae50-688ad2041c8c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:21.898234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb5cf0-0317-473b-bc92-e1b3e93577f5 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:21.928504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:21.929686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:21.929971 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:21.930247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] PATH_INFO: `/v3/services/image` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:21.930873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:21.932267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:21.941269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:21.942285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:21.943172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 522/1063] 10.222.0.46 () {56 vars in 1105 bytes} [Tue Jul 26 07:40:21 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:21.948822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:22.006343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb5cf0-0317-473b-bc92-e1b3e93577f5 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:22.045615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27ae76-a97d-4ddb-a79f-2ef5dbad34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:22.046185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ae76-a97d-4ddb-a79f-2ef5dbad34b8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:22.046471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ae76-a97d-4ddb-a79f-2ef5dbad34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:22.046747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ae76-a97d-4ddb-a79f-2ef5dbad34b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:22.053530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ba39d-809f-420c-8b01-8eb9ae3cf032 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:22.058005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27ae76-a97d-4ddb-a79f-2ef5dbad34b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-4e27ae76-a97d-4ddb-a79f-2ef5dbad34b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:22.062997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:22.063948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:22.064830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 542/1064] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:22.070157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27ae76-a97d-4ddb-a79f-2ef5dbad34b8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:22.081737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:22.093216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:22.093848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:22.094136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:22.094879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:22.095678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] RBAC: Adding query filter params (name=image) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:22.095960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:22.097289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:22.107722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 523/1065] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:22.108866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:22.113068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:22.187479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27ae76-a97d-4ddb-a79f-2ef5dbad34b8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:22.218851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c171-a97c-499f-9014-e76aed117fcf None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:22.223944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:22.224573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:22.224860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:22.225139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:22.225860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:22.226899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:22.228079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:22.239248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 543/1066] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:40:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:22.245587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:22.255265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:22.255907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:22.256178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:22.256455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:22.257144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] RBAC: Adding query filter params (type=image) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:22.257636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:22.259045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:22.264263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 524/1067] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:22.269990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:22.325153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:22.359624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:22.366852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9b85c-c6cc-4674-8a66-92e0c77808c7 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:22.378825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefabed-8248-4e4c-8b18-f2f497353a23 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:22.403644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f13b1-ec26-4603-bf97-d75eca03e4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:22.404296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f13b1-ec26-4603-bf97-d75eca03e4bd None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:22.404583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f13b1-ec26-4603-bf97-d75eca03e4bd None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:22.404863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f13b1-ec26-4603-bf97-d75eca03e4bd None admin] PATH_INFO: `/v3/users/dbd25c80d57249d8ad9add9dee984bf9` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:22.416253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8c24d-80e1-45dc-8536-a75394220e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:22.417195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8c24d-80e1-45dc-8536-a75394220e23 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:22.417697 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8c24d-80e1-45dc-8536-a75394220e23 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:22.418074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8c24d-80e1-45dc-8536-a75394220e23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:22.418791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8c24d-80e1-45dc-8536-a75394220e23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:22.419201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f13b1-ec26-4603-bf97-d75eca03e4bd None admin] RBAC: Authorizing `identity:get_user(user_id=dbd25c80d57249d8ad9add9dee984bf9)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:22.420228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8c24d-80e1-45dc-8536-a75394220e23 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:22.420660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f13b1-ec26-4603-bf97-d75eca03e4bd None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:22.422327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 544/1068] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:22 2022] GET /identity/v3/users/dbd25c80d57249d8ad9add9dee984bf9 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:22.428857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f13b1-ec26-4603-bf97-d75eca03e4bd None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:22.447596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 525/1069] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:40:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:40:22.544946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f13b1-ec26-4603-bf97-d75eca03e4bd None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:22.588907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b05a-2e27-427d-9e12-c271a718359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:22.589457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b05a-2e27-427d-9e12-c271a718359a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:22.589740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b05a-2e27-427d-9e12-c271a718359a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:22.590015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6b05a-2e27-427d-9e12-c271a718359a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:22.610486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:22.661995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6b05a-2e27-427d-9e12-c271a718359a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:22.664170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6b05a-2e27-427d-9e12-c271a718359a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:22.770970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 545/1070] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:40:22.773641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8c24d-80e1-45dc-8536-a75394220e23 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:22.881005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8c24d-80e1-45dc-8536-a75394220e23 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:22.890830 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:22.918097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dedd22-b417-45d8-8216-ad70c6e0b384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:22.918742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dedd22-b417-45d8-8216-ad70c6e0b384 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:22.919052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dedd22-b417-45d8-8216-ad70c6e0b384 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:22.919426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dedd22-b417-45d8-8216-ad70c6e0b384 None admin] PATH_INFO: `/v3/projects/74139a45ce2b4c36bf930bdf19800373` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:22.920769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dedd22-b417-45d8-8216-ad70c6e0b384 None admin] RBAC: Authorizing `identity:get_project(project_id=74139a45ce2b4c36bf930bdf19800373)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:22.922174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dedd22-b417-45d8-8216-ad70c6e0b384 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:22.926967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 526/1071] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:22 2022] GET /identity/v3/projects/74139a45ce2b4c36bf930bdf19800373 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:22.930365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b05a-2e27-427d-9e12-c271a718359a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:22.982228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:23.034850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6b05a-2e27-427d-9e12-c271a718359a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:23.069460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321f759-44d6-4a0d-841b-dafd140a6a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:23.070635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321f759-44d6-4a0d-841b-dafd140a6a17 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:23.070918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321f759-44d6-4a0d-841b-dafd140a6a17 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:23.071220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321f759-44d6-4a0d-841b-dafd140a6a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:23.072006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321f759-44d6-4a0d-841b-dafd140a6a17 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=74139a45ce2b4c36bf930bdf19800373, user.id=dbd25c80d57249d8ad9add9dee984bf9) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:23.072318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321f759-44d6-4a0d-841b-dafd140a6a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:23.073755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321f759-44d6-4a0d-841b-dafd140a6a17 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:23.087004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 546/1072] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:22 2022] GET /identity/v3/role_assignments?user.id=dbd25c80d57249d8ad9add9dee984bf9&scope.project.id=74139a45ce2b4c36bf930bdf19800373&role.id=53894f3146884908ba6dd3e118397fb3 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:23.573028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090cef-a9c6-4d27-86c7-c24d8bee7ffe None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:23.573440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090cef-a9c6-4d27-86c7-c24d8bee7ffe None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:23.573618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090cef-a9c6-4d27-86c7-c24d8bee7ffe None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:23.575023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 527/1073] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:23.580922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c860d-4cd1-4a1e-89d7-539a62c632de None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:23.581216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c860d-4cd1-4a1e-89d7-539a62c632de None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:23.581479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c860d-4cd1-4a1e-89d7-539a62c632de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:23.599718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ee8c860d-4cd1-4a1e-89d7-539a62c632de None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:23.601435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ee8c860d-4cd1-4a1e-89d7-539a62c632de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:23.667357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 547/1074] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:23.690049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090cef-a9c6-4d27-86c7-c24d8bee7ffe None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:23.794870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090cef-a9c6-4d27-86c7-c24d8bee7ffe None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:23.828271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c6d8-8992-48f0-b637-b1f717dc5632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:23.828851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c6d8-8992-48f0-b637-b1f717dc5632 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:23.829137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c6d8-8992-48f0-b637-b1f717dc5632 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:23.829415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c6d8-8992-48f0-b637-b1f717dc5632 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:23.847031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c6d8-8992-48f0-b637-b1f717dc5632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-b052c6d8-8992-48f0-b637-b1f717dc5632 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:23.852585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:23.853514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:23.859200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 528/1075] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jul 26 07:40:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:23.859908 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c860d-4cd1-4a1e-89d7-539a62c632de None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:23.905562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:23.961001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c860d-4cd1-4a1e-89d7-539a62c632de None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:23.994777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:23.995431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:23.995716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:23.995990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:23.996704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:23.997012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:23.998388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:24.010990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 548/1076] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jul 26 07:40:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:24.012222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c6d8-8992-48f0-b637-b1f717dc5632 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:24.050280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:24.116169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c6d8-8992-48f0-b637-b1f717dc5632 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:24.149501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:24.150163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:24.150444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:24.150717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:24.162945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:24.165089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:24.180088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:24.181002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:24.181890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:24.181890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:24.181890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:24.181890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:24.183247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 529/1077] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:24.186904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:24.287852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc91ce-bce0-4983-99ce-6af79f2d3562 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:24.294669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:24.322681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb51978-0f36-4270-be8c-f0e0e25ac7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:24.323342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51978-0f36-4270-be8c-f0e0e25ac7a9 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:24.323623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51978-0f36-4270-be8c-f0e0e25ac7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:24.323897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51978-0f36-4270-be8c-f0e0e25ac7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:24.324583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb51978-0f36-4270-be8c-f0e0e25ac7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:24.324886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb51978-0f36-4270-be8c-f0e0e25ac7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:24.326241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb51978-0f36-4270-be8c-f0e0e25ac7a9 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:24.342717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 549/1078] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:24.343992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:24.434567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:24.448213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550df67-4430-4057-b9ca-c8bbffc4aeda None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:24.472614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b7ca-2f4c-413a-9c45-6ef1aa6e6261 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:24.472911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b7ca-2f4c-413a-9c45-6ef1aa6e6261 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:24.473182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b7ca-2f4c-413a-9c45-6ef1aa6e6261 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:24.474542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 550/1079] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:40:24.479355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe306d2-6028-4a44-b503-6e88f9d58129 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:24.479606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe306d2-6028-4a44-b503-6e88f9d58129 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:24.479886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe306d2-6028-4a44-b503-6e88f9d58129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:24.482220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:24.482866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:24.483185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:24.483462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:24.492145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:24.494012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:24.498142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8fe306d2-6028-4a44-b503-6e88f9d58129 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:24.499364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8fe306d2-6028-4a44-b503-6e88f9d58129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:40:24.505280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:24.506185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 07:40:24.507691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:24.511080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 530/1080] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jul 26 07:40:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:24.512594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:24.571582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 551/1081] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:24.593252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe306d2-6028-4a44-b503-6e88f9d58129 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:24.620226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a54fb6-259e-460a-b672-7c48a8e30739 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:24.656524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:24.657243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:24.657527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:24.657833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:24.658695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:24.659026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:24.660451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:24.683616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 531/1082] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jul 26 07:40:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:24.684677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:24.690524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:24.695497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:24.697541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe306d2-6028-4a44-b503-6e88f9d58129 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:24.733611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267642-647f-4998-817f-10e36642a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:24.734240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267642-647f-4998-817f-10e36642a5fb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:24.734521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267642-647f-4998-817f-10e36642a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:24.734798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267642-647f-4998-817f-10e36642a5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:24.798151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45ccfd-ebf0-4129-960f-3443e2c98545 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:24.802719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267642-647f-4998-817f-10e36642a5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:24.804748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267642-647f-4998-817f-10e36642a5fb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:24.836001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c01fe-7227-4365-baf1-a7f4b3b30ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:24.836925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c01fe-7227-4365-baf1-a7f4b3b30ed7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:24.837421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c01fe-7227-4365-baf1-a7f4b3b30ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:24.838549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c01fe-7227-4365-baf1-a7f4b3b30ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:24.905911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:24.914275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 552/1083] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:40:24.915685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c01fe-7227-4365-baf1-a7f4b3b30ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:24.917149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c01fe-7227-4365-baf1-a7f4b3b30ed7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:24.920073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267642-647f-4998-817f-10e36642a5fb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:24.926243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.022603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267642-647f-4998-817f-10e36642a5fb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.029287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 532/1084] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:25.030188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c01fe-7227-4365-baf1-a7f4b3b30ed7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.066444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be172ea9-9bc1-42c5-8d0d-e38890e5cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.067173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172ea9-9bc1-42c5-8d0d-e38890e5cb69 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.067456 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172ea9-9bc1-42c5-8d0d-e38890e5cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.067742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172ea9-9bc1-42c5-8d0d-e38890e5cb69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.077707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be172ea9-9bc1-42c5-8d0d-e38890e5cb69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.079179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be172ea9-9bc1-42c5-8d0d-e38890e5cb69 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-be172ea9-9bc1-42c5-8d0d-e38890e5cb69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:25.093768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:25.094868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:25.096008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:25.096008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:25.096008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:25.096008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:25.096008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 553/1085] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:25.096529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93389e-7e00-40ba-b26c-7c4cd761fe0a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.096822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93389e-7e00-40ba-b26c-7c4cd761fe0a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.097101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93389e-7e00-40ba-b26c-7c4cd761fe0a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.098479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 554/1086] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:25.100637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93389e-7e00-40ba-b26c-7c4cd761fe0a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.132888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c01fe-7227-4365-baf1-a7f4b3b30ed7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.141253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.151963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.170260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7676-a5f8-4580-b64e-cf754e39126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.171217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7676-a5f8-4580-b64e-cf754e39126f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.171602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7676-a5f8-4580-b64e-cf754e39126f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.171973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7676-a5f8-4580-b64e-cf754e39126f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.184718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7676-a5f8-4580-b64e-cf754e39126f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.186168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7676-a5f8-4580-b64e-cf754e39126f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.203294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93389e-7e00-40ba-b26c-7c4cd761fe0a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-33da7676-a5f8-4580-b64e-cf754e39126f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:25.204340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:25.205204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:25.206087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:40:25.206087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:25.206087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:40:25.206087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:25.206087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 533/1087] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:25.206790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81a219-cd40-4b8d-bc55-a3429b14da0c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.207108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81a219-cd40-4b8d-bc55-a3429b14da0c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.207388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81a219-cd40-4b8d-bc55-a3429b14da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.224540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5d81a219-cd40-4b8d-bc55-a3429b14da0c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:25.225732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5d81a219-cd40-4b8d-bc55-a3429b14da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:25.240442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.241067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.241351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.242169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.242864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:25.243200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.244574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.255556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 555/1088] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:25.257404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.301122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 534/1089] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:25.323702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81a219-cd40-4b8d-bc55-a3429b14da0c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.372757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66d56c-b883-4dbd-a223-91d32897fc12 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.383339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.415822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.416370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.416654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.416925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.417627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:25.417932 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.419396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.426764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.432530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 556/1090] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:25.438058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.442282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81a219-cd40-4b8d-bc55-a3429b14da0c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.482318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373e3fb-127e-43c6-a07a-7e97017db582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.482994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e3fb-127e-43c6-a07a-7e97017db582 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.483281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e3fb-127e-43c6-a07a-7e97017db582 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.483556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e3fb-127e-43c6-a07a-7e97017db582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.494629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373e3fb-127e-43c6-a07a-7e97017db582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-7373e3fb-127e-43c6-a07a-7e97017db582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:25.499662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:25.500684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:25.501826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 535/1091] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:25.506909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373e3fb-127e-43c6-a07a-7e97017db582 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.554351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f320ac-ce0f-423d-b45c-da08dc56ae9b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.587976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.588620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.588904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.589176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.595758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.597204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:40:25.608997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:25.609965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:25.611101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 557/1092] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:25.615852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.618385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373e3fb-127e-43c6-a07a-7e97017db582 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.642444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.653558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.654170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.654451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.654729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.655480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:25.655785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.657150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.665715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 536/1093] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:25.671453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.683243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.715614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f9839-2fa6-4dad-8e38-d94ae4d4e39e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.750164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.750784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.751099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.751386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.752129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:25.752523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.753951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.766128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 558/1094] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:25.768716 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58063b10-7065-47e1-ba82-0cf95a10907f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.772230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.802462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee9900-f09a-48ab-89e3-af6190237628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.803124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee9900-f09a-48ab-89e3-af6190237628 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.803396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee9900-f09a-48ab-89e3-af6190237628 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.803670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee9900-f09a-48ab-89e3-af6190237628 None admin] PATH_INFO: `/v3/users/dbd25c80d57249d8ad9add9dee984bf9` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.804940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee9900-f09a-48ab-89e3-af6190237628 None admin] RBAC: Authorizing `identity:get_user(user_id=dbd25c80d57249d8ad9add9dee984bf9)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.806328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee9900-f09a-48ab-89e3-af6190237628 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.807965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 537/1095] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/users/dbd25c80d57249d8ad9add9dee984bf9 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:25.813515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee9900-f09a-48ab-89e3-af6190237628 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:25.863314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.875314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff921-444c-4f29-89ed-7a3b3649b6fc None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.893247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:25.910699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.911374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.911655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.911929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.912717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] RBAC: Adding query filter params (role.id=ab6850dbce74442d9ddfebc5c9d14617, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=867e92c5301945a88e5c0ed06c4b7257) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:25.913277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.914489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.915868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee9900-f09a-48ab-89e3-af6190237628 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:25.920232 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 559/1096] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/role_assignments?user.id=867e92c5301945a88e5c0ed06c4b7257&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=ab6850dbce74442d9ddfebc5c9d14617 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:25.951464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2bb93-0f6b-4d6b-880a-f5ca791eee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:25.952128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2bb93-0f6b-4d6b-880a-f5ca791eee72 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:25.952411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2bb93-0f6b-4d6b-880a-f5ca791eee72 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:25.952686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2bb93-0f6b-4d6b-880a-f5ca791eee72 None admin] PATH_INFO: `/v3/projects/74139a45ce2b4c36bf930bdf19800373` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:25.953917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2bb93-0f6b-4d6b-880a-f5ca791eee72 None admin] RBAC: Authorizing `identity:get_project(project_id=74139a45ce2b4c36bf930bdf19800373)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:25.955433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2bb93-0f6b-4d6b-880a-f5ca791eee72 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:25.957410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 538/1097] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:25 2022] GET /identity/v3/projects/74139a45ce2b4c36bf930bdf19800373 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:25.963989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:26.070862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590b4eb-95cd-4ae3-b9ba-3b5152803fd4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:26.105148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644ce60-6aa1-4e7f-a428-a7a1d1c3d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:26.105828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644ce60-6aa1-4e7f-a428-a7a1d1c3d31d None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:26.106111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644ce60-6aa1-4e7f-a428-a7a1d1c3d31d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:26.106388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644ce60-6aa1-4e7f-a428-a7a1d1c3d31d None admin] PATH_INFO: `/v3/projects/74139a45ce2b4c36bf930bdf19800373/users/dbd25c80d57249d8ad9add9dee984bf9/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:26.108366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644ce60-6aa1-4e7f-a428-a7a1d1c3d31d None admin] RBAC: Authorizing `identity:create_grant(project_id=74139a45ce2b4c36bf930bdf19800373, user_id=dbd25c80d57249d8ad9add9dee984bf9, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:26.109818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644ce60-6aa1-4e7f-a428-a7a1d1c3d31d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:26.124343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 560/1098] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:40:25 2022] PUT /identity/v3/projects/74139a45ce2b4c36bf930bdf19800373/users/dbd25c80d57249d8ad9add9dee984bf9/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:40:28.072423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760797-4e06-431d-8ccf-62613546881f None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:28.072965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760797-4e06-431d-8ccf-62613546881f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:28.072965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760797-4e06-431d-8ccf-62613546881f None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:28.074368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 539/1099] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:28.079406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea433102-cf77-4e4d-bf84-20a50f634661 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:28.079807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea433102-cf77-4e4d-bf84-20a50f634661 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:28.079960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea433102-cf77-4e4d-bf84-20a50f634661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:28.097538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ea433102-cf77-4e4d-bf84-20a50f634661 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:28.098646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ea433102-cf77-4e4d-bf84-20a50f634661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:28.106339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:28.165019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 561/1100] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:28.187551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760797-4e06-431d-8ccf-62613546881f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:28.285222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760797-4e06-431d-8ccf-62613546881f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:28.317908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e5b06-d788-4489-a6f5-38d365b10f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:28.318530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5b06-d788-4489-a6f5-38d365b10f80 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:28.318810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5b06-d788-4489-a6f5-38d365b10f80 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:28.319111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5b06-d788-4489-a6f5-38d365b10f80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:28.329219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e5b06-d788-4489-a6f5-38d365b10f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-ac1e5b06-d788-4489-a6f5-38d365b10f80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:28.334098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:28.335193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:28.336695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 540/1101] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:40:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:28.341384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea433102-cf77-4e4d-bf84-20a50f634661 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:28.435737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea433102-cf77-4e4d-bf84-20a50f634661 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:28.467799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:28.468398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:28.468674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:28.468943 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:28.469645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:28.469946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:28.471332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:28.479609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 562/1102] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:40:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:28.485090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e5b06-d788-4489-a6f5-38d365b10f80 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:28.493950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:28.581396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e5b06-d788-4489-a6f5-38d365b10f80 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:28.614007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa966211-9405-43f6-bd89-345deb93defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:28.614626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966211-9405-43f6-bd89-345deb93defb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:28.614907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966211-9405-43f6-bd89-345deb93defb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:28.615201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa966211-9405-43f6-bd89-345deb93defb None admin] PATH_INFO: `/v3/users/dbd25c80d57249d8ad9add9dee984bf9` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:28.616340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa966211-9405-43f6-bd89-345deb93defb None admin] RBAC: Authorizing `identity:get_user(user_id=dbd25c80d57249d8ad9add9dee984bf9)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:28.617785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa966211-9405-43f6-bd89-345deb93defb None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:28.619394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 541/1103] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:28 2022] GET /identity/v3/users/dbd25c80d57249d8ad9add9dee984bf9 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:28.624953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:28.628619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:28.721379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2779242-9afc-4e58-925d-5fb78ed6bcd6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:28.752583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ac739-9cd2-418a-87e2-55fa7b9d8730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:28.753183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ac739-9cd2-418a-87e2-55fa7b9d8730 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:28.753461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ac739-9cd2-418a-87e2-55fa7b9d8730 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:28.753732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ac739-9cd2-418a-87e2-55fa7b9d8730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:28.817423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ac739-9cd2-418a-87e2-55fa7b9d8730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:28.818843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ac739-9cd2-418a-87e2-55fa7b9d8730 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:28.821856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:28.914221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 563/1104] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:28.920015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa966211-9405-43f6-bd89-345deb93defb None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:28.992567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:29.017767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa966211-9405-43f6-bd89-345deb93defb None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:29.050302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d32e81-a1b4-42ca-b0a7-e47f2aae2978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:29.050965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d32e81-a1b4-42ca-b0a7-e47f2aae2978 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:29.051245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d32e81-a1b4-42ca-b0a7-e47f2aae2978 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:29.051520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d32e81-a1b4-42ca-b0a7-e47f2aae2978 None admin] PATH_INFO: `/v3/projects/74139a45ce2b4c36bf930bdf19800373` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:29.052670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d32e81-a1b4-42ca-b0a7-e47f2aae2978 None admin] RBAC: Authorizing `identity:get_project(project_id=74139a45ce2b4c36bf930bdf19800373)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:29.054619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d32e81-a1b4-42ca-b0a7-e47f2aae2978 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:29.056303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 542/1105] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:28 2022] GET /identity/v3/projects/74139a45ce2b4c36bf930bdf19800373 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:29.062370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ac739-9cd2-418a-87e2-55fa7b9d8730 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:29.157196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ac739-9cd2-418a-87e2-55fa7b9d8730 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:29.159486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:29.189940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2dd919-dfc8-493a-9cf5-f75641a1d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:29.190537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dd919-dfc8-493a-9cf5-f75641a1d442 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:29.190815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dd919-dfc8-493a-9cf5-f75641a1d442 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:29.191127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dd919-dfc8-493a-9cf5-f75641a1d442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:29.191899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dd919-dfc8-493a-9cf5-f75641a1d442 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=74139a45ce2b4c36bf930bdf19800373, user.id=dbd25c80d57249d8ad9add9dee984bf9) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:29.192208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dd919-dfc8-493a-9cf5-f75641a1d442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:29.193612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dd919-dfc8-493a-9cf5-f75641a1d442 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:29.199793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 564/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:29 2022] GET /identity/v3/role_assignments?user.id=dbd25c80d57249d8ad9add9dee984bf9&scope.project.id=74139a45ce2b4c36bf930bdf19800373&role.id=53894f3146884908ba6dd3e118397fb3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:31.222102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df993-776e-41a7-b90e-3da9cb9fb544 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:31.222622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df993-776e-41a7-b90e-3da9cb9fb544 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:31.222712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243df993-776e-41a7-b90e-3da9cb9fb544 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:31.224016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 543/1107] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:31.229136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668a39-ee23-4951-ac7b-cde36cc50663 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:31.229525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668a39-ee23-4951-ac7b-cde36cc50663 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:31.229696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24668a39-ee23-4951-ac7b-cde36cc50663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:31.248019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-24668a39-ee23-4951-ac7b-cde36cc50663 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:31.249200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-24668a39-ee23-4951-ac7b-cde36cc50663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:31.314085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 565/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:31.338310 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243df993-776e-41a7-b90e-3da9cb9fb544 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:31.435929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243df993-776e-41a7-b90e-3da9cb9fb544 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:31.467799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be1e4f-3b7d-4141-9d79-5fa2a4af0a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:31.468428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be1e4f-3b7d-4141-9d79-5fa2a4af0a68 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:31.468707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be1e4f-3b7d-4141-9d79-5fa2a4af0a68 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:31.468976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be1e4f-3b7d-4141-9d79-5fa2a4af0a68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:31.470105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be1e4f-3b7d-4141-9d79-5fa2a4af0a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:31.471555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be1e4f-3b7d-4141-9d79-5fa2a4af0a68 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:31.473144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 544/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:31.478765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24668a39-ee23-4951-ac7b-cde36cc50663 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:31.571869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:31.575465 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24668a39-ee23-4951-ac7b-cde36cc50663 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:31.607681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3e379-e51e-40e6-9296-1eb28013be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:31.608287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3e379-e51e-40e6-9296-1eb28013be31 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:31.608569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3e379-e51e-40e6-9296-1eb28013be31 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:31.608842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3e379-e51e-40e6-9296-1eb28013be31 None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:31.609523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3e379-e51e-40e6-9296-1eb28013be31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:31.610975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3e379-e51e-40e6-9296-1eb28013be31 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:31.631371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 566/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:40:31 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:33.625295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476ff6-ee44-4310-9a93-0528953202f4 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:33.625828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476ff6-ee44-4310-9a93-0528953202f4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:33.625828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476ff6-ee44-4310-9a93-0528953202f4 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:33.627204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 545/1111] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:33.632895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de659-6727-447b-ab33-f42216ff9592 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:33.633266 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de659-6727-447b-ab33-f42216ff9592 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:33.633454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de659-6727-447b-ab33-f42216ff9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:33.651573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-653de659-6727-447b-ab33-f42216ff9592 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:33.652766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-653de659-6727-447b-ab33-f42216ff9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:33.717666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 567/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:33.739940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa476ff6-ee44-4310-9a93-0528953202f4 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:33.752804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:33.839617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa476ff6-ee44-4310-9a93-0528953202f4 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:33.872570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3209b-2451-4620-8ac6-b55c37803350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:33.873201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3209b-2451-4620-8ac6-b55c37803350 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:33.873484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3209b-2451-4620-8ac6-b55c37803350 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:33.873763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3209b-2451-4620-8ac6-b55c37803350 None admin] PATH_INFO: `/v3/roles/b1f864ecbe4c43b4a5a708fa216488d4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:33.875231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3209b-2451-4620-8ac6-b55c37803350 None admin] RBAC: Authorizing `identity:get_role(role_id=b1f864ecbe4c43b4a5a708fa216488d4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:33.876641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3209b-2451-4620-8ac6-b55c37803350 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:33.877927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 546/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:33 2022] GET /identity/v3/roles/b1f864ecbe4c43b4a5a708fa216488d4 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:33.884439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653de659-6727-447b-ab33-f42216ff9592 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:33.965614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:33.982494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653de659-6727-447b-ab33-f42216ff9592 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:34.015775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e6a6d-2039-4874-944a-df583d1abe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:34.016406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e6a6d-2039-4874-944a-df583d1abe7f None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:34.016690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e6a6d-2039-4874-944a-df583d1abe7f None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:34.016966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e6a6d-2039-4874-944a-df583d1abe7f None admin] PATH_INFO: `/v3/users/a41e4b1bb0af4d9e8c85d6078a2dd58a` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:34.029938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e6a6d-2039-4874-944a-df583d1abe7f None admin] RBAC: Authorizing `identity:get_user(user_id=a41e4b1bb0af4d9e8c85d6078a2dd58a)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:34.031421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e6a6d-2039-4874-944a-df583d1abe7f None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:34.033024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 568/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:33 2022] GET /identity/v3/users/a41e4b1bb0af4d9e8c85d6078a2dd58a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:34.039153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3209b-2451-4620-8ac6-b55c37803350 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:34.115057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:34.136433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3209b-2451-4620-8ac6-b55c37803350 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:34.168456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca267b7-6f78-435c-81f4-8fab1a1513ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:34.169052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca267b7-6f78-435c-81f4-8fab1a1513ec None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:34.169329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca267b7-6f78-435c-81f4-8fab1a1513ec None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:34.169601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca267b7-6f78-435c-81f4-8fab1a1513ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:34.233889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca267b7-6f78-435c-81f4-8fab1a1513ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:34.235389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca267b7-6f78-435c-81f4-8fab1a1513ec None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:34.308864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:34.330205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 547/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:34.336425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e6a6d-2039-4874-944a-df583d1abe7f None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:34.431027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e6a6d-2039-4874-944a-df583d1abe7f None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:34.463162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b4e4-6769-484a-9f77-a1b832b94cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:34.463784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b4e4-6769-484a-9f77-a1b832b94cca None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:34.464063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b4e4-6769-484a-9f77-a1b832b94cca None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:34.464334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b4e4-6769-484a-9f77-a1b832b94cca None admin] PATH_INFO: `/v3/projects/74139a45ce2b4c36bf930bdf19800373` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:34.465458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b4e4-6769-484a-9f77-a1b832b94cca None admin] RBAC: Authorizing `identity:get_project(project_id=74139a45ce2b4c36bf930bdf19800373)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:34.466985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b4e4-6769-484a-9f77-a1b832b94cca None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:34.468593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 569/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:34 2022] GET /identity/v3/projects/74139a45ce2b4c36bf930bdf19800373 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:34.474380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca267b7-6f78-435c-81f4-8fab1a1513ec None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:34.569569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca267b7-6f78-435c-81f4-8fab1a1513ec None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:34.602824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafe49c-d796-4822-b71e-de81175c419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:34.603464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe49c-d796-4822-b71e-de81175c419b None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:34.603747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe49c-d796-4822-b71e-de81175c419b None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:34.604022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe49c-d796-4822-b71e-de81175c419b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:34.604799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafe49c-d796-4822-b71e-de81175c419b None admin] RBAC: Adding query filter params (role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=74139a45ce2b4c36bf930bdf19800373, user.id=a41e4b1bb0af4d9e8c85d6078a2dd58a) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:34.605113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafe49c-d796-4822-b71e-de81175c419b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:34.606541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafe49c-d796-4822-b71e-de81175c419b None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:34.611794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 548/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:34 2022] GET /identity/v3/role_assignments?user.id=a41e4b1bb0af4d9e8c85d6078a2dd58a&scope.project.id=74139a45ce2b4c36bf930bdf19800373&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:36.545371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71006-6360-4775-9b17-dcbb00798d38 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:36.545920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71006-6360-4775-9b17-dcbb00798d38 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:36.545920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71006-6360-4775-9b17-dcbb00798d38 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:36.547308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 570/1118] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:36.552510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f17cf-6daa-4711-adb1-f3ac53e6d9d7 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:36.552914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f17cf-6daa-4711-adb1-f3ac53e6d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:36.553062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f17cf-6daa-4711-adb1-f3ac53e6d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:36.571765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-279f17cf-6daa-4711-adb1-f3ac53e6d9d7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:36.572939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-279f17cf-6daa-4711-adb1-f3ac53e6d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:36.605891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:36.637489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 549/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:36.659280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e71006-6360-4775-9b17-dcbb00798d38 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:36.671202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:36.758820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e71006-6360-4775-9b17-dcbb00798d38 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:36.791854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132a81c-df62-4eea-843c-3633da02e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:36.792480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132a81c-df62-4eea-843c-3633da02e46b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:36.792761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132a81c-df62-4eea-843c-3633da02e46b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:36.793036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132a81c-df62-4eea-843c-3633da02e46b None admin] PATH_INFO: `/v3/roles/b1f864ecbe4c43b4a5a708fa216488d4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:36.794471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132a81c-df62-4eea-843c-3633da02e46b None admin] RBAC: Authorizing `identity:get_role(role_id=b1f864ecbe4c43b4a5a708fa216488d4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:36.795910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132a81c-df62-4eea-843c-3633da02e46b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:36.797189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 571/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:36 2022] GET /identity/v3/roles/b1f864ecbe4c43b4a5a708fa216488d4 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:36.802949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f17cf-6daa-4711-adb1-f3ac53e6d9d7 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:36.898428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f17cf-6daa-4711-adb1-f3ac53e6d9d7 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:36.931100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fff25a-b523-46c5-a425-317bc1726982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:36.931737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff25a-b523-46c5-a425-317bc1726982 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:36.932017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff25a-b523-46c5-a425-317bc1726982 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:36.932293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fff25a-b523-46c5-a425-317bc1726982 None admin] PATH_INFO: `/v3/users/a41e4b1bb0af4d9e8c85d6078a2dd58a` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:36.933455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fff25a-b523-46c5-a425-317bc1726982 None admin] RBAC: Authorizing `identity:get_user(user_id=a41e4b1bb0af4d9e8c85d6078a2dd58a)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:36.934894 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fff25a-b523-46c5-a425-317bc1726982 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:36.936525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 550/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:36 2022] GET /identity/v3/users/a41e4b1bb0af4d9e8c85d6078a2dd58a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:36.942342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132a81c-df62-4eea-843c-3633da02e46b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:37.019169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:37.040544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132a81c-df62-4eea-843c-3633da02e46b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:37.073215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367384-baa8-40fe-b6f4-7c5fc99ffffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:37.073796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367384-baa8-40fe-b6f4-7c5fc99ffffa None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:37.074076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367384-baa8-40fe-b6f4-7c5fc99ffffa None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:37.074353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367384-baa8-40fe-b6f4-7c5fc99ffffa None admin] PATH_INFO: `/v3/projects/74139a45ce2b4c36bf930bdf19800373` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:37.075545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367384-baa8-40fe-b6f4-7c5fc99ffffa None admin] RBAC: Authorizing `identity:get_project(project_id=74139a45ce2b4c36bf930bdf19800373)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:37.076973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367384-baa8-40fe-b6f4-7c5fc99ffffa None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:37.078619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 572/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:36 2022] GET /identity/v3/projects/74139a45ce2b4c36bf930bdf19800373 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:37.084526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fff25a-b523-46c5-a425-317bc1726982 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:37.125644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:37.181561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fff25a-b523-46c5-a425-317bc1726982 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:37.214161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4365e3-2e31-4918-a083-32d18a50e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:37.214812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4365e3-2e31-4918-a083-32d18a50e5f4 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:37.215124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4365e3-2e31-4918-a083-32d18a50e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:37.215399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4365e3-2e31-4918-a083-32d18a50e5f4 None admin] PATH_INFO: `/v3/projects/74139a45ce2b4c36bf930bdf19800373/users/a41e4b1bb0af4d9e8c85d6078a2dd58a/roles/b1f864ecbe4c43b4a5a708fa216488d4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:37.217574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4365e3-2e31-4918-a083-32d18a50e5f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=74139a45ce2b4c36bf930bdf19800373, user_id=a41e4b1bb0af4d9e8c85d6078a2dd58a, role_id=b1f864ecbe4c43b4a5a708fa216488d4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:37.219024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4365e3-2e31-4918-a083-32d18a50e5f4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:37.231404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 551/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:40:37 2022] PUT /identity/v3/projects/74139a45ce2b4c36bf930bdf19800373/users/a41e4b1bb0af4d9e8c85d6078a2dd58a/roles/b1f864ecbe4c43b4a5a708fa216488d4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:40:39.173607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35593675-4b8e-42f2-951e-44856f93c96f None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:39.174166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35593675-4b8e-42f2-951e-44856f93c96f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:39.174166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35593675-4b8e-42f2-951e-44856f93c96f None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:39.175534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 573/1124] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:39.180776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213fa4-96c7-4f92-8f8d-0173dabfdc6f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:39.181222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213fa4-96c7-4f92-8f8d-0173dabfdc6f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:39.181366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213fa4-96c7-4f92-8f8d-0173dabfdc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:39.199402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f3213fa4-96c7-4f92-8f8d-0173dabfdc6f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:39.200584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f3213fa4-96c7-4f92-8f8d-0173dabfdc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:39.264761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 552/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:39.287772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35593675-4b8e-42f2-951e-44856f93c96f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:39.385129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35593675-4b8e-42f2-951e-44856f93c96f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:39.417799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953cd05-2a51-4bb8-aa4c-4f578d96dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:39.418425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953cd05-2a51-4bb8-aa4c-4f578d96dac5 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:39.418705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953cd05-2a51-4bb8-aa4c-4f578d96dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:39.419005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953cd05-2a51-4bb8-aa4c-4f578d96dac5 None admin] PATH_INFO: `/v3/roles/b1f864ecbe4c43b4a5a708fa216488d4` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:39.420435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953cd05-2a51-4bb8-aa4c-4f578d96dac5 None admin] RBAC: Authorizing `identity:get_role(role_id=b1f864ecbe4c43b4a5a708fa216488d4)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:39.421798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953cd05-2a51-4bb8-aa4c-4f578d96dac5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:39.423155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 574/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:39 2022] GET /identity/v3/roles/b1f864ecbe4c43b4a5a708fa216488d4 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:39.428872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3213fa4-96c7-4f92-8f8d-0173dabfdc6f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:39.457775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:39.526911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3213fa4-96c7-4f92-8f8d-0173dabfdc6f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:39.559446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c9264-3661-464a-94aa-1c2b685e9b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:39.560074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c9264-3661-464a-94aa-1c2b685e9b73 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:39.560352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c9264-3661-464a-94aa-1c2b685e9b73 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:39.560626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c9264-3661-464a-94aa-1c2b685e9b73 None admin] PATH_INFO: `/v3/users/a41e4b1bb0af4d9e8c85d6078a2dd58a` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:39.561766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c9264-3661-464a-94aa-1c2b685e9b73 None admin] RBAC: Authorizing `identity:get_user(user_id=a41e4b1bb0af4d9e8c85d6078a2dd58a)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:39.563223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c9264-3661-464a-94aa-1c2b685e9b73 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:39.564799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 553/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:39 2022] GET /identity/v3/users/a41e4b1bb0af4d9e8c85d6078a2dd58a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:39.571000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953cd05-2a51-4bb8-aa4c-4f578d96dac5 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:39.586179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:39.667814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953cd05-2a51-4bb8-aa4c-4f578d96dac5 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:39.701136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3702545-fe45-4962-b273-4532c0c5fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:39.701687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3702545-fe45-4962-b273-4532c0c5fe1d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:39.701968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3702545-fe45-4962-b273-4532c0c5fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:39.702244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3702545-fe45-4962-b273-4532c0c5fe1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:39.766593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3702545-fe45-4962-b273-4532c0c5fe1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:39.768070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3702545-fe45-4962-b273-4532c0c5fe1d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:39.782048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:39.866637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 575/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:39.872612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c9264-3661-464a-94aa-1c2b685e9b73 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:39.965943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:39.969942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c9264-3661-464a-94aa-1c2b685e9b73 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:40.003898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6884247-5ed7-47f2-be4f-b5fa252a8bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:40.004533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884247-5ed7-47f2-be4f-b5fa252a8bd4 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:40.004818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884247-5ed7-47f2-be4f-b5fa252a8bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:40.005093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6884247-5ed7-47f2-be4f-b5fa252a8bd4 None admin] PATH_INFO: `/v3/projects/74139a45ce2b4c36bf930bdf19800373` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:40.006246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6884247-5ed7-47f2-be4f-b5fa252a8bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=74139a45ce2b4c36bf930bdf19800373)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:40.007720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6884247-5ed7-47f2-be4f-b5fa252a8bd4 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:40.009369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 554/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:39 2022] GET /identity/v3/projects/74139a45ce2b4c36bf930bdf19800373 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:40.015464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3702545-fe45-4962-b273-4532c0c5fe1d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:40.111339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3702545-fe45-4962-b273-4532c0c5fe1d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:40.125286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:40.145322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02975f5-a73a-4050-8581-b3056fe41c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:40.145927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02975f5-a73a-4050-8581-b3056fe41c76 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:40.146215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02975f5-a73a-4050-8581-b3056fe41c76 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:40.146491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02975f5-a73a-4050-8581-b3056fe41c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:40.147302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02975f5-a73a-4050-8581-b3056fe41c76 None admin] RBAC: Adding query filter params (role.id=b1f864ecbe4c43b4a5a708fa216488d4, scope.project.id=74139a45ce2b4c36bf930bdf19800373, user.id=a41e4b1bb0af4d9e8c85d6078a2dd58a) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:40.147641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02975f5-a73a-4050-8581-b3056fe41c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:40.149066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02975f5-a73a-4050-8581-b3056fe41c76 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:40.154677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 576/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:40 2022] GET /identity/v3/role_assignments?user.id=a41e4b1bb0af4d9e8c85d6078a2dd58a&scope.project.id=74139a45ce2b4c36bf930bdf19800373&role.id=b1f864ecbe4c43b4a5a708fa216488d4 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:42.172066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdb9f4-9c6b-44e0-8f4f-6a05dc065fb7 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:42.172584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdb9f4-9c6b-44e0-8f4f-6a05dc065fb7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:42.172685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdb9f4-9c6b-44e0-8f4f-6a05dc065fb7 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:42.173948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 555/1131] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:42.178979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6c6ab-8024-42bd-86a5-5034425d52e2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:42.179405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6c6ab-8024-42bd-86a5-5034425d52e2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:42.179546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6c6ab-8024-42bd-86a5-5034425d52e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:42.198377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-61a6c6ab-8024-42bd-86a5-5034425d52e2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:42.199593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-61a6c6ab-8024-42bd-86a5-5034425d52e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:42.263802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 577/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:42.287049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdb9f4-9c6b-44e0-8f4f-6a05dc065fb7 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:42.383465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdb9f4-9c6b-44e0-8f4f-6a05dc065fb7 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:42.415878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e804c5-4d26-47ff-afce-fe62b3637155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:42.416495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e804c5-4d26-47ff-afce-fe62b3637155 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:42.416770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e804c5-4d26-47ff-afce-fe62b3637155 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:42.417042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e804c5-4d26-47ff-afce-fe62b3637155 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:42.418167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e804c5-4d26-47ff-afce-fe62b3637155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:42.419616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e804c5-4d26-47ff-afce-fe62b3637155 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:42.421162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 556/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:42.426809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6c6ab-8024-42bd-86a5-5034425d52e2 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:42.521244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6c6ab-8024-42bd-86a5-5034425d52e2 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:42.530529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:42.555172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68611688-5b05-4069-8373-d84f9ea5ac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:42.555794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68611688-5b05-4069-8373-d84f9ea5ac30 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:42.556073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68611688-5b05-4069-8373-d84f9ea5ac30 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:42.556393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68611688-5b05-4069-8373-d84f9ea5ac30 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:42.557032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68611688-5b05-4069-8373-d84f9ea5ac30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:42.558485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68611688-5b05-4069-8373-d84f9ea5ac30 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:42.583904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 578/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:40:42 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:44.570500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4cead-c72d-4961-8b93-788b775e7799 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:44.571077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4cead-c72d-4961-8b93-788b775e7799 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:44.571077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4cead-c72d-4961-8b93-788b775e7799 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:44.572417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 557/1135] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:44.577426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1353-8613-4c0d-bab7-4561689601d0 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:44.577862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1353-8613-4c0d-bab7-4561689601d0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:44.578001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1353-8613-4c0d-bab7-4561689601d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:44.595756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b4dc1353-8613-4c0d-bab7-4561689601d0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:44.596984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b4dc1353-8613-4c0d-bab7-4561689601d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:44.661806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 579/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:44.686721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4cead-c72d-4961-8b93-788b775e7799 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:44.721040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:44.786065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4cead-c72d-4961-8b93-788b775e7799 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:44.819199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f720ad-f065-4f64-beab-c2f82e4e4105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:44.819830 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f720ad-f065-4f64-beab-c2f82e4e4105 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:44.820112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f720ad-f065-4f64-beab-c2f82e4e4105 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:44.820388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f720ad-f065-4f64-beab-c2f82e4e4105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:44.821584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f720ad-f065-4f64-beab-c2f82e4e4105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:44.822989 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f720ad-f065-4f64-beab-c2f82e4e4105 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:44.824555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 558/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:44.830074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc1353-8613-4c0d-bab7-4561689601d0 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:44.918179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:44.930562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc1353-8613-4c0d-bab7-4561689601d0 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:44.967482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cb6c3-b7fc-473e-889b-2f38203173c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:44.968099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cb6c3-b7fc-473e-889b-2f38203173c5 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:44.968385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cb6c3-b7fc-473e-889b-2f38203173c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:44.968663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cb6c3-b7fc-473e-889b-2f38203173c5 None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:44.969347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cb6c3-b7fc-473e-889b-2f38203173c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:44.970787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cb6c3-b7fc-473e-889b-2f38203173c5 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:44.990912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 580/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:40:44 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:40:47.023739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43fbf6-85f9-4842-8097-060f3e38675c None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:47.024281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43fbf6-85f9-4842-8097-060f3e38675c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:47.024281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43fbf6-85f9-4842-8097-060f3e38675c None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:47.025617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 559/1139] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:47.030662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729fa7d-71d5-43b7-b508-e63a7a519f7e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:47.031122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729fa7d-71d5-43b7-b508-e63a7a519f7e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:47.031256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729fa7d-71d5-43b7-b508-e63a7a519f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:47.049557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-1729fa7d-71d5-43b7-b508-e63a7a519f7e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:47.050754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1729fa7d-71d5-43b7-b508-e63a7a519f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:47.116069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 581/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:47.138718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43fbf6-85f9-4842-8097-060f3e38675c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:47.236265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43fbf6-85f9-4842-8097-060f3e38675c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:47.237744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:47.270313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680553fe-1ed3-48ad-a8d8-f115033467a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:47.270951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680553fe-1ed3-48ad-a8d8-f115033467a0 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:47.271243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680553fe-1ed3-48ad-a8d8-f115033467a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:47.271512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680553fe-1ed3-48ad-a8d8-f115033467a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:47.281709 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680553fe-1ed3-48ad-a8d8-f115033467a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-680553fe-1ed3-48ad-a8d8-f115033467a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:47.286553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:47.287749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:47.289534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 560/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:47.294170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729fa7d-71d5-43b7-b508-e63a7a519f7e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:47.367735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:47.390560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729fa7d-71d5-43b7-b508-e63a7a519f7e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:47.425382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:47.425995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:47.426281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:47.426560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:47.427308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:47.427621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:47.429026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:47.436843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 582/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:47.442365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680553fe-1ed3-48ad-a8d8-f115033467a0 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:47.538845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680553fe-1ed3-48ad-a8d8-f115033467a0 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:47.570708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba938a-50bc-4926-859a-334a37a71df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:47.571353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba938a-50bc-4926-859a-334a37a71df1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:47.571633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba938a-50bc-4926-859a-334a37a71df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:47.571905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba938a-50bc-4926-859a-334a37a71df1 None admin] PATH_INFO: `/v3/users/f143808b708c4defb217a7ffa92a84bb` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:47.584402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba938a-50bc-4926-859a-334a37a71df1 None admin] RBAC: Authorizing `identity:get_user(user_id=f143808b708c4defb217a7ffa92a84bb)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:47.586373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba938a-50bc-4926-859a-334a37a71df1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:47.587968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 561/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:47 2022] GET /identity/v3/users/f143808b708c4defb217a7ffa92a84bb => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:40:47.593476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:47.690705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601768d5-95f2-45a4-9574-ef826ab8ed50 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:47.723836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962be41-6bf5-43b0-8c5b-ecf6a29ca82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:47.724447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962be41-6bf5-43b0-8c5b-ecf6a29ca82e None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:47.724731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962be41-6bf5-43b0-8c5b-ecf6a29ca82e None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:47.725009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962be41-6bf5-43b0-8c5b-ecf6a29ca82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:47.733169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:47.793877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962be41-6bf5-43b0-8c5b-ecf6a29ca82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:47.795358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962be41-6bf5-43b0-8c5b-ecf6a29ca82e None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:47.892435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 583/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:47.898437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba938a-50bc-4926-859a-334a37a71df1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:47.919655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:47.995080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba938a-50bc-4926-859a-334a37a71df1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:48.027707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e978c94-a16a-40d7-951e-23ae33cb5094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:48.028336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978c94-a16a-40d7-951e-23ae33cb5094 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:48.028615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978c94-a16a-40d7-951e-23ae33cb5094 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:48.028890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978c94-a16a-40d7-951e-23ae33cb5094 None admin] PATH_INFO: `/v3/projects/4290c6d1cf394ef3beb05f75cb05d7b2` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:48.030042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e978c94-a16a-40d7-951e-23ae33cb5094 None admin] RBAC: Authorizing `identity:get_project(project_id=4290c6d1cf394ef3beb05f75cb05d7b2)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:48.031500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e978c94-a16a-40d7-951e-23ae33cb5094 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:48.033140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 562/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:47 2022] GET /identity/v3/projects/4290c6d1cf394ef3beb05f75cb05d7b2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:48.039140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962be41-6bf5-43b0-8c5b-ecf6a29ca82e None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:48.077246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:48.134056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962be41-6bf5-43b0-8c5b-ecf6a29ca82e None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:48.166189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777ba3-b437-4611-bdfd-b9a06ed7c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:48.166792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777ba3-b437-4611-bdfd-b9a06ed7c6be None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:48.167103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777ba3-b437-4611-bdfd-b9a06ed7c6be None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:48.167382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777ba3-b437-4611-bdfd-b9a06ed7c6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:48.168162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777ba3-b437-4611-bdfd-b9a06ed7c6be None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=4290c6d1cf394ef3beb05f75cb05d7b2, user.id=f143808b708c4defb217a7ffa92a84bb) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:48.168475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777ba3-b437-4611-bdfd-b9a06ed7c6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:48.169892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777ba3-b437-4611-bdfd-b9a06ed7c6be None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:48.175121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 584/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:48 2022] GET /identity/v3/role_assignments?user.id=f143808b708c4defb217a7ffa92a84bb&scope.project.id=4290c6d1cf394ef3beb05f75cb05d7b2&role.id=53894f3146884908ba6dd3e118397fb3 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:50.107252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050209a-2091-4669-98c5-4c851fd735d0 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:50.107776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050209a-2091-4669-98c5-4c851fd735d0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:50.107776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050209a-2091-4669-98c5-4c851fd735d0 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:50.109057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 563/1147] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:50.114100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74d635-6576-4e74-85da-4695242c99f4 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:50.114507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74d635-6576-4e74-85da-4695242c99f4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:50.114651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74d635-6576-4e74-85da-4695242c99f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:50.132625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-fc74d635-6576-4e74-85da-4695242c99f4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:50.133804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fc74d635-6576-4e74-85da-4695242c99f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:50.198157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 585/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:50.220269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050209a-2091-4669-98c5-4c851fd735d0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:50.306374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:50.320202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050209a-2091-4669-98c5-4c851fd735d0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:50.352140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6fa62-fc56-4f2a-8078-766d295af742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:50.352757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6fa62-fc56-4f2a-8078-766d295af742 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:50.353037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6fa62-fc56-4f2a-8078-766d295af742 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:50.353311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6fa62-fc56-4f2a-8078-766d295af742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:50.363093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6fa62-fc56-4f2a-8078-766d295af742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-97e6fa62-fc56-4f2a-8078-766d295af742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:50.368418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:50.369483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:50.370663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 564/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:50.375453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74d635-6576-4e74-85da-4695242c99f4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:50.405309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:50.471190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74d635-6576-4e74-85da-4695242c99f4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:50.504365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:50.504971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:50.505252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:50.505527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:50.506236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:50.506542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:50.507941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:50.515719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 586/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:50.521486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6fa62-fc56-4f2a-8078-766d295af742 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:50.623038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6fa62-fc56-4f2a-8078-766d295af742 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:50.656122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7d493-0c0b-4d13-9d26-844ee119a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:50.656752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d493-0c0b-4d13-9d26-844ee119a174 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:50.657038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d493-0c0b-4d13-9d26-844ee119a174 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:50.657319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d493-0c0b-4d13-9d26-844ee119a174 None admin] PATH_INFO: `/v3/users/f143808b708c4defb217a7ffa92a84bb` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:50.658481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d493-0c0b-4d13-9d26-844ee119a174 None admin] RBAC: Authorizing `identity:get_user(user_id=f143808b708c4defb217a7ffa92a84bb)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:50.659942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d493-0c0b-4d13-9d26-844ee119a174 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:50.661535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 565/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:50 2022] GET /identity/v3/users/f143808b708c4defb217a7ffa92a84bb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:50.667726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:50.758939 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:50.766140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f5bef-2fa3-4d71-a7e3-f71764d1e2cb None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:50.798288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a77852-2591-4d3f-bfcf-9ae2a0b82ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:50.798917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77852-2591-4d3f-bfcf-9ae2a0b82ff9 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:50.799223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77852-2591-4d3f-bfcf-9ae2a0b82ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:50.799498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77852-2591-4d3f-bfcf-9ae2a0b82ff9 None admin] PATH_INFO: `/v3/projects/4290c6d1cf394ef3beb05f75cb05d7b2` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:50.800662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a77852-2591-4d3f-bfcf-9ae2a0b82ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=4290c6d1cf394ef3beb05f75cb05d7b2)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:50.802088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a77852-2591-4d3f-bfcf-9ae2a0b82ff9 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:50.804319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 587/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:50 2022] GET /identity/v3/projects/4290c6d1cf394ef3beb05f75cb05d7b2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:50.810013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7d493-0c0b-4d13-9d26-844ee119a174 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:50.827608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:50.909485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7d493-0c0b-4d13-9d26-844ee119a174 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:50.943381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5223c-a48e-4413-a713-f74de57b0818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:50.944042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5223c-a48e-4413-a713-f74de57b0818 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:50.944352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5223c-a48e-4413-a713-f74de57b0818 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:50.944631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5223c-a48e-4413-a713-f74de57b0818 None admin] PATH_INFO: `/v3/projects/4290c6d1cf394ef3beb05f75cb05d7b2/users/f143808b708c4defb217a7ffa92a84bb/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:50.946590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5223c-a48e-4413-a713-f74de57b0818 None admin] RBAC: Authorizing `identity:create_grant(project_id=4290c6d1cf394ef3beb05f75cb05d7b2, user_id=f143808b708c4defb217a7ffa92a84bb, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:50.948055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5223c-a48e-4413-a713-f74de57b0818 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:50.960765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 566/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:40:50 2022] PUT /identity/v3/projects/4290c6d1cf394ef3beb05f75cb05d7b2/users/f143808b708c4defb217a7ffa92a84bb/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:40:52.916067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183cfcf-03fb-499c-9e0b-8cd69cff4ff2 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:52.916563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183cfcf-03fb-499c-9e0b-8cd69cff4ff2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:52.916665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183cfcf-03fb-499c-9e0b-8cd69cff4ff2 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:52.917952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 588/1154] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:52.923158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12b25-19ad-4ce5-9f78-d73ddbef4fe4 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:52.923541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12b25-19ad-4ce5-9f78-d73ddbef4fe4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:52.923712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12b25-19ad-4ce5-9f78-d73ddbef4fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:52.941903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ecf12b25-19ad-4ce5-9f78-d73ddbef4fe4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:52.943106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ecf12b25-19ad-4ce5-9f78-d73ddbef4fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:53.006501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 567/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:53.028811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183cfcf-03fb-499c-9e0b-8cd69cff4ff2 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:53.129241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183cfcf-03fb-499c-9e0b-8cd69cff4ff2 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:53.161625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1c08b-a623-4d47-a713-411c19b010b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:53.162248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1c08b-a623-4d47-a713-411c19b010b4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:53.162527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1c08b-a623-4d47-a713-411c19b010b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:53.162916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1c08b-a623-4d47-a713-411c19b010b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:53.173111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1c08b-a623-4d47-a713-411c19b010b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-ccb1c08b-a623-4d47-a713-411c19b010b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:40:53.177975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:53.179094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:40:53.180269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 589/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:40:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:40:53.185117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12b25-19ad-4ce5-9f78-d73ddbef4fe4 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:53.192966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:53.281197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12b25-19ad-4ce5-9f78-d73ddbef4fe4 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:53.313743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:53.314345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:53.314626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:53.314900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:53.315643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:53.315947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:53.317314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:53.325131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 568/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:53.330651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1c08b-a623-4d47-a713-411c19b010b4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:53.355755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:53.428459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1c08b-a623-4d47-a713-411c19b010b4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:53.462303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150b69c-6f0c-46ac-83ce-32f219ce9d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:53.462948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150b69c-6f0c-46ac-83ce-32f219ce9d4d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:53.463230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150b69c-6f0c-46ac-83ce-32f219ce9d4d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:53.463499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150b69c-6f0c-46ac-83ce-32f219ce9d4d None admin] PATH_INFO: `/v3/users/f143808b708c4defb217a7ffa92a84bb` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:53.464642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150b69c-6f0c-46ac-83ce-32f219ce9d4d None admin] RBAC: Authorizing `identity:get_user(user_id=f143808b708c4defb217a7ffa92a84bb)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:53.466055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150b69c-6f0c-46ac-83ce-32f219ce9d4d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:53.467664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 590/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:40:53 2022] GET /identity/v3/users/f143808b708c4defb217a7ffa92a84bb => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:53.473319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:53.537874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:53.570637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b934405-b8dc-4607-8b70-e8dba5f51357 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:53.602875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef03eb-b241-4884-ba19-f80901d70256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:53.603508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef03eb-b241-4884-ba19-f80901d70256 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:53.603789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef03eb-b241-4884-ba19-f80901d70256 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:53.604064 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef03eb-b241-4884-ba19-f80901d70256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:53.668489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef03eb-b241-4884-ba19-f80901d70256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:53.669917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef03eb-b241-4884-ba19-f80901d70256 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:53.731732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:53.764863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 569/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:53.770800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150b69c-6f0c-46ac-83ce-32f219ce9d4d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:53.858306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:53.867934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150b69c-6f0c-46ac-83ce-32f219ce9d4d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:53.900861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec3c84-c496-4749-9a70-3e3d4e7052de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:53.901495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3c84-c496-4749-9a70-3e3d4e7052de None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:53.901778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3c84-c496-4749-9a70-3e3d4e7052de None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:53.902052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3c84-c496-4749-9a70-3e3d4e7052de None admin] PATH_INFO: `/v3/projects/4290c6d1cf394ef3beb05f75cb05d7b2` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:53.903229 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec3c84-c496-4749-9a70-3e3d4e7052de None admin] RBAC: Authorizing `identity:get_project(project_id=4290c6d1cf394ef3beb05f75cb05d7b2)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:53.904656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec3c84-c496-4749-9a70-3e3d4e7052de None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:53.906310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 591/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:40:53 2022] GET /identity/v3/projects/4290c6d1cf394ef3beb05f75cb05d7b2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:53.912318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef03eb-b241-4884-ba19-f80901d70256 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:54.007446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef03eb-b241-4884-ba19-f80901d70256 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:54.040491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e7d41-2dac-4da6-9d1f-824c8c6e166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:54.041085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e7d41-2dac-4da6-9d1f-824c8c6e166d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:54.041362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e7d41-2dac-4da6-9d1f-824c8c6e166d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:54.041632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e7d41-2dac-4da6-9d1f-824c8c6e166d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:54.042411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e7d41-2dac-4da6-9d1f-824c8c6e166d None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=4290c6d1cf394ef3beb05f75cb05d7b2, user.id=f143808b708c4defb217a7ffa92a84bb) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:54.042719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e7d41-2dac-4da6-9d1f-824c8c6e166d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:54.044170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e7d41-2dac-4da6-9d1f-824c8c6e166d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:54.050251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 570/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:40:53 2022] GET /identity/v3/role_assignments?user.id=f143808b708c4defb217a7ffa92a84bb&scope.project.id=4290c6d1cf394ef3beb05f75cb05d7b2&role.id=53894f3146884908ba6dd3e118397fb3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:56.028562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92cbe-2025-46cc-b2ea-c1f3f4d7dd44 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:56.029069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92cbe-2025-46cc-b2ea-c1f3f4d7dd44 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:56.029188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92cbe-2025-46cc-b2ea-c1f3f4d7dd44 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:56.030463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 592/1162] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:56.035636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470bc3-9860-464d-a379-9c1650f95f7c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:56.036043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470bc3-9860-464d-a379-9c1650f95f7c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:56.036188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470bc3-9860-464d-a379-9c1650f95f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:56.055348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8d470bc3-9860-464d-a379-9c1650f95f7c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:56.056529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8d470bc3-9860-464d-a379-9c1650f95f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:56.081719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:56.121717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 571/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:40:56.143742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac92cbe-2025-46cc-b2ea-c1f3f4d7dd44 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:56.242234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac92cbe-2025-46cc-b2ea-c1f3f4d7dd44 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:56.275018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a997b8-77ad-481c-abb4-5ec6af0f7d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:56.275622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a997b8-77ad-481c-abb4-5ec6af0f7d34 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:56.275900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a997b8-77ad-481c-abb4-5ec6af0f7d34 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:56.276170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a997b8-77ad-481c-abb4-5ec6af0f7d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:56.301296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:56.341296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a997b8-77ad-481c-abb4-5ec6af0f7d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:56.342726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a997b8-77ad-481c-abb4-5ec6af0f7d34 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:56.436622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 593/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:40:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:40:56.442471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d470bc3-9860-464d-a379-9c1650f95f7c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:56.536305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d470bc3-9860-464d-a379-9c1650f95f7c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:56.570012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932468f-0c98-4ad1-9994-63263b9e3d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:56.570637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932468f-0c98-4ad1-9994-63263b9e3d56 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:56.570913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932468f-0c98-4ad1-9994-63263b9e3d56 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:56.571212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932468f-0c98-4ad1-9994-63263b9e3d56 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:56.577643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932468f-0c98-4ad1-9994-63263b9e3d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:56.579095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932468f-0c98-4ad1-9994-63263b9e3d56 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-2932468f-0c98-4ad1-9994-63263b9e3d56 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:40:56.590329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:40:56.591543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:40:56.592713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 572/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:40:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:40:56.597283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a997b8-77ad-481c-abb4-5ec6af0f7d34 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:56.652965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:56.693268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a997b8-77ad-481c-abb4-5ec6af0f7d34 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:56.725087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e067762-d464-43c7-8e9a-841832b334e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:56.726211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e067762-d464-43c7-8e9a-841832b334e6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:56.726488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e067762-d464-43c7-8e9a-841832b334e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:56.726759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e067762-d464-43c7-8e9a-841832b334e6 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:56.727473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e067762-d464-43c7-8e9a-841832b334e6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:40:56.727775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e067762-d464-43c7-8e9a-841832b334e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:56.729122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e067762-d464-43c7-8e9a-841832b334e6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:56.736061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 594/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jul 26 07:40:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:40:58.687817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d1d5-bd39-45b8-9844-50667c521f50 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:58.688429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d1d5-bd39-45b8-9844-50667c521f50 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:58.688429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d1d5-bd39-45b8-9844-50667c521f50 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:58.689727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 573/1167] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:40:58.695391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a0993-8ba2-4718-93b9-27c13a0fa6b2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:58.695813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a0993-8ba2-4718-93b9-27c13a0fa6b2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:58.695946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a0993-8ba2-4718-93b9-27c13a0fa6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:58.713765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-1f3a0993-8ba2-4718-93b9-27c13a0fa6b2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:40:58.714987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1f3a0993-8ba2-4718-93b9-27c13a0fa6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:40:58.779097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 595/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:40:58.801226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d1d5-bd39-45b8-9844-50667c521f50 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:40:58.825190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:40:58.901112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d1d5-bd39-45b8-9844-50667c521f50 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:40:58.934332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112ea9c-cc8c-4a4b-89fe-8bb5e5f9bb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:40:58.934956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112ea9c-cc8c-4a4b-89fe-8bb5e5f9bb87 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:40:58.935246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112ea9c-cc8c-4a4b-89fe-8bb5e5f9bb87 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:40:58.935519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112ea9c-cc8c-4a4b-89fe-8bb5e5f9bb87 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:40:58.936220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112ea9c-cc8c-4a4b-89fe-8bb5e5f9bb87 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:40:58.937581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112ea9c-cc8c-4a4b-89fe-8bb5e5f9bb87 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:40:58.952739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 574/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Tue Jul 26 07:40:58 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:41:00.948227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2359-1b2c-482a-8c5a-46536e41ce60 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:00.948722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2359-1b2c-482a-8c5a-46536e41ce60 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:00.948836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2359-1b2c-482a-8c5a-46536e41ce60 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:00.950123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 596/1170] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:41:00.955329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b957-4a38-43ca-af21-eb790d36db75 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:00.955725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b957-4a38-43ca-af21-eb790d36db75 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:00.955880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b957-4a38-43ca-af21-eb790d36db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:00.973394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e2c2b957-4a38-43ca-af21-eb790d36db75 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:41:00.974577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e2c2b957-4a38-43ca-af21-eb790d36db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:01.038945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 575/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:41:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:41:01.062620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca2359-1b2c-482a-8c5a-46536e41ce60 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:01.119644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:01.169957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca2359-1b2c-482a-8c5a-46536e41ce60 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:01.202502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1386df-1fde-4ec8-92bf-66537e2144d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:01.203158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1386df-1fde-4ec8-92bf-66537e2144d6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:01.203439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1386df-1fde-4ec8-92bf-66537e2144d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:01.203712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1386df-1fde-4ec8-92bf-66537e2144d6 None admin] PATH_INFO: `/v3/domains/0ab345def0b04611b68eb4bbe2d10092` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:01.213759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1386df-1fde-4ec8-92bf-66537e2144d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0ab345def0b04611b68eb4bbe2d10092)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:01.215216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1386df-1fde-4ec8-92bf-66537e2144d6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:01.216807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 597/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Tue Jul 26 07:41:01 2022] GET /identity/v3/domains/0ab345def0b04611b68eb4bbe2d10092 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:01.222645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b957-4a38-43ca-af21-eb790d36db75 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:01.236813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:01.319277 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b957-4a38-43ca-af21-eb790d36db75 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:01.352112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473191-b623-46d0-b86f-99de483e30ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:01.352715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473191-b623-46d0-b86f-99de483e30ff None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:01.352994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473191-b623-46d0-b86f-99de483e30ff None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:01.353268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473191-b623-46d0-b86f-99de483e30ff None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:01.353953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93473191-b623-46d0-b86f-99de483e30ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:01.355485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93473191-b623-46d0-b86f-99de483e30ff None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:01.381173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 576/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:41:01 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:41:03.392096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26d37-407c-4537-9933-a7e7644c7442 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:03.392645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26d37-407c-4537-9933-a7e7644c7442 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:03.392645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26d37-407c-4537-9933-a7e7644c7442 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:03.394256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 598/1174] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:41:03.399413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b32c-ef9a-4203-acb9-8b37b436556b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:03.399814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b32c-ef9a-4203-acb9-8b37b436556b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:03.399969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b32c-ef9a-4203-acb9-8b37b436556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:03.418135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5f64b32c-ef9a-4203-acb9-8b37b436556b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:41:03.419359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5f64b32c-ef9a-4203-acb9-8b37b436556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:03.476818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:03.486168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 577/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:41:03.510234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae26d37-407c-4537-9933-a7e7644c7442 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:03.608292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae26d37-407c-4537-9933-a7e7644c7442 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:03.620742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:03.641562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1522976-66e0-4ea3-ae16-0813f8f6e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:03.642235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522976-66e0-4ea3-ae16-0813f8f6e3ec None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:03.642467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522976-66e0-4ea3-ae16-0813f8f6e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:03.642738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522976-66e0-4ea3-ae16-0813f8f6e3ec None admin] PATH_INFO: `/v3/domains/0ab345def0b04611b68eb4bbe2d10092` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:03.644158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522976-66e0-4ea3-ae16-0813f8f6e3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=0ab345def0b04611b68eb4bbe2d10092)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:03.645577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522976-66e0-4ea3-ae16-0813f8f6e3ec None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:03.647683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 599/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Tue Jul 26 07:41:03 2022] GET /identity/v3/domains/0ab345def0b04611b68eb4bbe2d10092 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:03.653364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64b32c-ef9a-4203-acb9-8b37b436556b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:03.749134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64b32c-ef9a-4203-acb9-8b37b436556b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:03.781840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f97b0b-12f9-4a54-973b-7d0e7275f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:03.782444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f97b0b-12f9-4a54-973b-7d0e7275f3fc None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:03.782725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f97b0b-12f9-4a54-973b-7d0e7275f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:03.783022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f97b0b-12f9-4a54-973b-7d0e7275f3fc None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:03.783702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f97b0b-12f9-4a54-973b-7d0e7275f3fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:03.785118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f97b0b-12f9-4a54-973b-7d0e7275f3fc None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:03.805611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 578/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:41:03 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:41:05.805377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c3cf6-9c28-4d29-a428-86e3ae845def None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:05.805933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c3cf6-9c28-4d29-a428-86e3ae845def None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:05.805933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c3cf6-9c28-4d29-a428-86e3ae845def None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:05.807315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 600/1178] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:41:05.812452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f052762-5dcf-4c88-869b-ec6f53760501 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:05.812848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f052762-5dcf-4c88-869b-ec6f53760501 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:05.813009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f052762-5dcf-4c88-869b-ec6f53760501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:05.831304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3f052762-5dcf-4c88-869b-ec6f53760501 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:41:05.832490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3f052762-5dcf-4c88-869b-ec6f53760501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:05.877698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:05.899373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 579/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 07:41:05.922242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c3cf6-9c28-4d29-a428-86e3ae845def None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:06.020562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c3cf6-9c28-4d29-a428-86e3ae845def None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:06.052909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2da8f0-831e-4bb6-8f93-9d0de0b658a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:06.054054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2da8f0-831e-4bb6-8f93-9d0de0b658a8 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:06.054331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2da8f0-831e-4bb6-8f93-9d0de0b658a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:06.054603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2da8f0-831e-4bb6-8f93-9d0de0b658a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:06.064527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2da8f0-831e-4bb6-8f93-9d0de0b658a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-7a2da8f0-831e-4bb6-8f93-9d0de0b658a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:41:06.069945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:41:06.071045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:41:06.072040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 601/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:41:06.076936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f052762-5dcf-4c88-869b-ec6f53760501 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:06.171841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f052762-5dcf-4c88-869b-ec6f53760501 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:06.204932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:06.205543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:06.205825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:06.206100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:06.206812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:41:06.207144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:06.208507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:06.216276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 580/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:41:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:06.221673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2da8f0-831e-4bb6-8f93-9d0de0b658a8 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:06.262521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:06.319815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2da8f0-831e-4bb6-8f93-9d0de0b658a8 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:06.351866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359100b5-67bf-41c5-8dd0-52e002e25a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:06.352483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359100b5-67bf-41c5-8dd0-52e002e25a24 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:06.352760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359100b5-67bf-41c5-8dd0-52e002e25a24 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:06.353031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359100b5-67bf-41c5-8dd0-52e002e25a24 None admin] PATH_INFO: `/v3/users/6f9f2d62e6c34e5e99680662a7cdc618` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:06.365462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359100b5-67bf-41c5-8dd0-52e002e25a24 None admin] RBAC: Authorizing `identity:get_user(user_id=6f9f2d62e6c34e5e99680662a7cdc618)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:06.366921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359100b5-67bf-41c5-8dd0-52e002e25a24 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:06.368535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 602/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:41:06 2022] GET /identity/v3/users/6f9f2d62e6c34e5e99680662a7cdc618 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:06.374336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:06.417132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:06.472693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2117-2f3a-4893-ae75-6458bf8b4d68 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:06.504299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9baf-82cc-4372-9064-b0fb8607aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:06.504902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9baf-82cc-4372-9064-b0fb8607aad7 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:06.505185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9baf-82cc-4372-9064-b0fb8607aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:06.505458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9baf-82cc-4372-9064-b0fb8607aad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:06.571863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc9baf-82cc-4372-9064-b0fb8607aad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:06.573244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc9baf-82cc-4372-9064-b0fb8607aad7 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:06.612235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:06.667418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 581/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:41:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 07:41:06.673233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359100b5-67bf-41c5-8dd0-52e002e25a24 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:06.768512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:06.772876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359100b5-67bf-41c5-8dd0-52e002e25a24 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:06.805917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca0af5-cd53-4981-bc25-26bd65b7f2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:06.806550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0af5-cd53-4981-bc25-26bd65b7f2a6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:06.806831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0af5-cd53-4981-bc25-26bd65b7f2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:06.807134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0af5-cd53-4981-bc25-26bd65b7f2a6 None admin] PATH_INFO: `/v3/projects/747ccf33f24e44d5b165cd2332b98663` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:06.808304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca0af5-cd53-4981-bc25-26bd65b7f2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=747ccf33f24e44d5b165cd2332b98663)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:06.809740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca0af5-cd53-4981-bc25-26bd65b7f2a6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:06.811432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 603/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:41:06 2022] GET /identity/v3/projects/747ccf33f24e44d5b165cd2332b98663 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:06.817433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9baf-82cc-4372-9064-b0fb8607aad7 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:06.914243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9baf-82cc-4372-9064-b0fb8607aad7 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:06.947458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37f31e-4981-454e-a368-54f67b727a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:06.948057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f31e-4981-454e-a368-54f67b727a77 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:06.948339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f31e-4981-454e-a368-54f67b727a77 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:06.948617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37f31e-4981-454e-a368-54f67b727a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:06.949397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37f31e-4981-454e-a368-54f67b727a77 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=747ccf33f24e44d5b165cd2332b98663, user.id=6f9f2d62e6c34e5e99680662a7cdc618) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:41:06.949709 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37f31e-4981-454e-a368-54f67b727a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:06.951151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37f31e-4981-454e-a368-54f67b727a77 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:06.956351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 582/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:41:06 2022] GET /identity/v3/role_assignments?user.id=6f9f2d62e6c34e5e99680662a7cdc618&scope.project.id=747ccf33f24e44d5b165cd2332b98663&role.id=53894f3146884908ba6dd3e118397fb3 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:08.895242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11188c47-d3f0-4646-8917-6d70097f8ee2 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:08.895721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11188c47-d3f0-4646-8917-6d70097f8ee2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:08.895822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11188c47-d3f0-4646-8917-6d70097f8ee2 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:08.897656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 604/1186] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:41:08.902649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ff54-7e29-4598-b83d-27c54953687e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:08.903117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ff54-7e29-4598-b83d-27c54953687e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:08.903217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ff54-7e29-4598-b83d-27c54953687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:08.916470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:08.922063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0c63ff54-7e29-4598-b83d-27c54953687e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:41:08.923271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0c63ff54-7e29-4598-b83d-27c54953687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:08.986868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 583/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:41:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:41:09.008961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11188c47-d3f0-4646-8917-6d70097f8ee2 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.107292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11188c47-d3f0-4646-8917-6d70097f8ee2 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.139349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e225-c26f-4ff6-8a66-f0a049f3ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.139972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e225-c26f-4ff6-8a66-f0a049f3ef96 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.140255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e225-c26f-4ff6-8a66-f0a049f3ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.140533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e225-c26f-4ff6-8a66-f0a049f3ef96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.151158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28e225-c26f-4ff6-8a66-f0a049f3ef96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-cc28e225-c26f-4ff6-8a66-f0a049f3ef96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:41:09.156090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:41:09.157233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:41:09.158322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:41:09.161937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 605/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:41:09.163560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63ff54-7e29-4598-b83d-27c54953687e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.265612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63ff54-7e29-4598-b83d-27c54953687e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.298214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.298816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.299127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.299400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.300108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:41:09.300412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:09.301765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:09.303898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:09.310130 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 584/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:09.315861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e225-c26f-4ff6-8a66-f0a049f3ef96 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.343765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:09.414744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e225-c26f-4ff6-8a66-f0a049f3ef96 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.447304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803801c-6dc1-4cfa-9409-500b89ee1f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.447924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803801c-6dc1-4cfa-9409-500b89ee1f24 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.448206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803801c-6dc1-4cfa-9409-500b89ee1f24 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.448480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803801c-6dc1-4cfa-9409-500b89ee1f24 None admin] PATH_INFO: `/v3/users/6f9f2d62e6c34e5e99680662a7cdc618` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.449622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803801c-6dc1-4cfa-9409-500b89ee1f24 None admin] RBAC: Authorizing `identity:get_user(user_id=6f9f2d62e6c34e5e99680662a7cdc618)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:09.451062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803801c-6dc1-4cfa-9409-500b89ee1f24 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:09.452624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 606/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:41:09 2022] GET /identity/v3/users/6f9f2d62e6c34e5e99680662a7cdc618 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:09.458103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.555560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c45e1-f3dd-47f2-964b-d77020108ca5 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.587981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72415b0b-637c-4f5d-b7bc-eabc38338ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.588602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72415b0b-637c-4f5d-b7bc-eabc38338ab5 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.588882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72415b0b-637c-4f5d-b7bc-eabc38338ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.589153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72415b0b-637c-4f5d-b7bc-eabc38338ab5 None admin] PATH_INFO: `/v3/projects/747ccf33f24e44d5b165cd2332b98663` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.590298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72415b0b-637c-4f5d-b7bc-eabc38338ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=747ccf33f24e44d5b165cd2332b98663)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:09.591749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72415b0b-637c-4f5d-b7bc-eabc38338ab5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:09.593378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 585/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:41:09 2022] GET /identity/v3/projects/747ccf33f24e44d5b165cd2332b98663 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:41:09.599194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803801c-6dc1-4cfa-9409-500b89ee1f24 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:09.688920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:09.696746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803801c-6dc1-4cfa-9409-500b89ee1f24 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:09.729676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8829b-50e1-4b28-8cb7-1230eaab9293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:09.730331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8829b-50e1-4b28-8cb7-1230eaab9293 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:09.730615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8829b-50e1-4b28-8cb7-1230eaab9293 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:09.730893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8829b-50e1-4b28-8cb7-1230eaab9293 None admin] PATH_INFO: `/v3/projects/747ccf33f24e44d5b165cd2332b98663/users/6f9f2d62e6c34e5e99680662a7cdc618/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:09.732845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8829b-50e1-4b28-8cb7-1230eaab9293 None admin] RBAC: Authorizing `identity:create_grant(project_id=747ccf33f24e44d5b165cd2332b98663, user_id=6f9f2d62e6c34e5e99680662a7cdc618, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:09.734274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8829b-50e1-4b28-8cb7-1230eaab9293 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:09.747083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 607/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:41:09 2022] PUT /identity/v3/projects/747ccf33f24e44d5b165cd2332b98663/users/6f9f2d62e6c34e5e99680662a7cdc618/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:41:11.701496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307685-9b38-4f04-b6d5-68bec53f4468 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:11.702044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307685-9b38-4f04-b6d5-68bec53f4468 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:11.702044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81307685-9b38-4f04-b6d5-68bec53f4468 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:11.703438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 586/1193] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:41:11.708508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62512e-0b1a-4604-b142-56fe2e9ade93 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:11.708886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62512e-0b1a-4604-b142-56fe2e9ade93 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:11.709055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62512e-0b1a-4604-b142-56fe2e9ade93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:11.727228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4c62512e-0b1a-4604-b142-56fe2e9ade93 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:41:11.728411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4c62512e-0b1a-4604-b142-56fe2e9ade93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:41:11.793350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 608/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:41:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:41:11.816301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81307685-9b38-4f04-b6d5-68bec53f4468 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:11.880936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:11.916599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81307685-9b38-4f04-b6d5-68bec53f4468 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:11.948154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d480fe-d494-4666-9356-a2691b1e5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:11.948777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d480fe-d494-4666-9356-a2691b1e5528 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:11.949057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d480fe-d494-4666-9356-a2691b1e5528 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:11.949331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d480fe-d494-4666-9356-a2691b1e5528 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:11.960004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d480fe-d494-4666-9356-a2691b1e5528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-10d480fe-d494-4666-9356-a2691b1e5528 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:41:11.964796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:41:11.965881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:41:11.966822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 587/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:41:11.972048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62512e-0b1a-4604-b142-56fe2e9ade93 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:12.052238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:12.068166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62512e-0b1a-4604-b142-56fe2e9ade93 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:12.101190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:12.101796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:12.102078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:12.102353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:12.103088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:41:12.103397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:12.104764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:12.112502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 609/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:12.118152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d480fe-d494-4666-9356-a2691b1e5528 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:12.215948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d480fe-d494-4666-9356-a2691b1e5528 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:12.239650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:12.248589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce81c5-c9af-4123-b139-8a4a7ef4f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:12.249208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce81c5-c9af-4123-b139-8a4a7ef4f8ee None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:12.249487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce81c5-c9af-4123-b139-8a4a7ef4f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:12.249759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce81c5-c9af-4123-b139-8a4a7ef4f8ee None admin] PATH_INFO: `/v3/users/6f9f2d62e6c34e5e99680662a7cdc618` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:12.250899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce81c5-c9af-4123-b139-8a4a7ef4f8ee None admin] RBAC: Authorizing `identity:get_user(user_id=6f9f2d62e6c34e5e99680662a7cdc618)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:12.252345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce81c5-c9af-4123-b139-8a4a7ef4f8ee None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:12.253915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 588/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jul 26 07:41:12 2022] GET /identity/v3/users/6f9f2d62e6c34e5e99680662a7cdc618 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:41:12.260037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:12.356166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84dba2-3c68-49a6-851f-6738fe408924 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:12.388138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b96ab-cb7b-4574-a2a7-7169d748095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:12.388740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b96ab-cb7b-4574-a2a7-7169d748095d None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:12.389022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b96ab-cb7b-4574-a2a7-7169d748095d None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:12.389299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b96ab-cb7b-4574-a2a7-7169d748095d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:12.404515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:12.454708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b96ab-cb7b-4574-a2a7-7169d748095d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:12.456178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b96ab-cb7b-4574-a2a7-7169d748095d None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:12.550172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 610/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:41:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:41:12.557051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce81c5-c9af-4123-b139-8a4a7ef4f8ee None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:12.652122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce81c5-c9af-4123-b139-8a4a7ef4f8ee None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:12.683839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a505313-7967-420a-8bfa-ffc0f1ed0a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:12.684459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a505313-7967-420a-8bfa-ffc0f1ed0a93 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:12.684738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a505313-7967-420a-8bfa-ffc0f1ed0a93 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:12.685010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a505313-7967-420a-8bfa-ffc0f1ed0a93 None admin] PATH_INFO: `/v3/projects/747ccf33f24e44d5b165cd2332b98663` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:12.686144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a505313-7967-420a-8bfa-ffc0f1ed0a93 None admin] RBAC: Authorizing `identity:get_project(project_id=747ccf33f24e44d5b165cd2332b98663)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:12.687585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a505313-7967-420a-8bfa-ffc0f1ed0a93 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:12.689200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 589/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jul 26 07:41:12 2022] GET /identity/v3/projects/747ccf33f24e44d5b165cd2332b98663 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:12.695588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b96ab-cb7b-4574-a2a7-7169d748095d None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:41:12.739184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:12.789878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b96ab-cb7b-4574-a2a7-7169d748095d None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:41:12.823114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a68992-44e4-493c-b7e9-19b0b2704ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:41:12.823662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68992-44e4-493c-b7e9-19b0b2704ea0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:41:12.823944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68992-44e4-493c-b7e9-19b0b2704ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:41:12.824220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a68992-44e4-493c-b7e9-19b0b2704ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:41:12.825000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a68992-44e4-493c-b7e9-19b0b2704ea0 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=747ccf33f24e44d5b165cd2332b98663, user.id=6f9f2d62e6c34e5e99680662a7cdc618) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:41:12.825312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a68992-44e4-493c-b7e9-19b0b2704ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:41:12.826744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a68992-44e4-493c-b7e9-19b0b2704ea0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:41:12.832401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 611/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:41:12 2022] GET /identity/v3/role_assignments?user.id=6f9f2d62e6c34e5e99680662a7cdc618&scope.project.id=747ccf33f24e44d5b165cd2332b98663&role.id=53894f3146884908ba6dd3e118397fb3 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:41:22.679895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=69 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:41:22.829850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=45 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:07.344558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f212c5-fa0e-4e7c-ae86-359203fdaed0 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:07.345145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f212c5-fa0e-4e7c-ae86-359203fdaed0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:07.345145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f212c5-fa0e-4e7c-ae86-359203fdaed0 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:07.346460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 590/1201] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:07.352037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cfad0-8055-4ba2-a28f-6ab5df87a26d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:07.352508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cfad0-8055-4ba2-a28f-6ab5df87a26d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:07.352596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cfad0-8055-4ba2-a28f-6ab5df87a26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:07.379743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9e7cfad0-8055-4ba2-a28f-6ab5df87a26d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:07.381737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9e7cfad0-8055-4ba2-a28f-6ab5df87a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:07.466120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 612/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:07.493550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f212c5-fa0e-4e7c-ae86-359203fdaed0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:07.625293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f212c5-fa0e-4e7c-ae86-359203fdaed0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:07.668914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:07.669606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:07.669918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:07.670201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:07.682583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:07.684204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:07.701883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:07.703380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:07.704540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:07.704540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:07.704540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:07.704540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:07.704540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 591/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:07.709620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cfad0-8055-4ba2-a28f-6ab5df87a26d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:07.837633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cfad0-8055-4ba2-a28f-6ab5df87a26d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:07.881395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:07.889208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257b79a-2cae-4238-b634-f544299d4ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:07.889843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b79a-2cae-4238-b634-f544299d4ed7 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:07.890198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b79a-2cae-4238-b634-f544299d4ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:07.890478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b79a-2cae-4238-b634-f544299d4ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:07.891329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257b79a-2cae-4238-b634-f544299d4ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:07.891715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257b79a-2cae-4238-b634-f544299d4ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:07.893334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257b79a-2cae-4238-b634-f544299d4ed7 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:07.910319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 613/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:07.917193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:07.991176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:08.050335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ec16a-c066-495a-8320-fe213c7b2ea3 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:08.095987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721048f-83d8-405f-b21c-55bf05bc0387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:08.096740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721048f-83d8-405f-b21c-55bf05bc0387 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:08.096995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721048f-83d8-405f-b21c-55bf05bc0387 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:08.097341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721048f-83d8-405f-b21c-55bf05bc0387 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:08.098096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721048f-83d8-405f-b21c-55bf05bc0387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:08.100343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721048f-83d8-405f-b21c-55bf05bc0387 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:08.127021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 592/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jul 26 07:42:07 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:42:10.562150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84828636-b453-4149-9757-e40ff0fb8278 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:10.562150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84828636-b453-4149-9757-e40ff0fb8278 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:10.562150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84828636-b453-4149-9757-e40ff0fb8278 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:10.562150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 614/1206] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:10.569450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb0a6-e77b-4937-b9e1-e56ef0205575 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:10.570379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb0a6-e77b-4937-b9e1-e56ef0205575 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:10.570880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb0a6-e77b-4937-b9e1-e56ef0205575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:10.596147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-434fb0a6-e77b-4937-b9e1-e56ef0205575 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:10.598566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-434fb0a6-e77b-4937-b9e1-e56ef0205575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:10.694962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 593/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:10.719898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84828636-b453-4149-9757-e40ff0fb8278 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:10.854453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84828636-b453-4149-9757-e40ff0fb8278 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:10.894552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5295-1c94-440e-87a6-f61c32b1d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:10.895715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5295-1c94-440e-87a6-f61c32b1d2be None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:10.896414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5295-1c94-440e-87a6-f61c32b1d2be None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:10.896731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5295-1c94-440e-87a6-f61c32b1d2be None admin] PATH_INFO: `/v3/roles/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:10.912201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5295-1c94-440e-87a6-f61c32b1d2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-cc4c5295-1c94-440e-87a6-f61c32b1d2be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:42:10.917429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:10.918526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:10.919580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 615/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:42:10.925176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fb0a6-e77b-4937-b9e1-e56ef0205575 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:10.973022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:11.043682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fb0a6-e77b-4937-b9e1-e56ef0205575 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:11.084312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:11.084966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:11.085248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:11.085537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:11.086304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:11.086627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:11.088148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:11.111113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 594/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:11.112914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5295-1c94-440e-87a6-f61c32b1d2be None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:11.177556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:11.229987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5295-1c94-440e-87a6-f61c32b1d2be None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:11.270788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:11.271509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:11.271774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:11.272032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:11.283211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:11.284724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:11.300895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:11.302438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:11.308270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:11.308270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:11.308270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:11.308270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:11.308270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 616/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:11.308644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:11.412451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:11.416014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5998a-b20d-4819-ba43-137b295878e9 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:11.454588 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:11.455268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:11.455548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:11.455821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:11.456516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:11.456817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:11.458217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:11.471635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 595/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:11.478313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:11.600478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56a26-e56c-4b33-8272-5bfea0e70a15 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:11.602471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:11.641984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:11.642626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:11.642909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:11.643211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:11.651481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:11.653004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:42:11.666687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:11.667933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:11.669129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:11.675165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 617/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:11.677474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:11.790022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ece058-8455-424f-8bc3-cd969dc0f946 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:11.829747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:11.830373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:11.830660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:11.830960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:11.831776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:11.832084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:11.834055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:11.855647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 596/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jul 26 07:42:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:11.861541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:11.979941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c1f6-9746-458e-9b9c-874205bd1683 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:12.016685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254dd4-bb4f-40e5-97ef-9a102ebd3c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:12.017386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254dd4-bb4f-40e5-97ef-9a102ebd3c91 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:12.017641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254dd4-bb4f-40e5-97ef-9a102ebd3c91 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:12.017965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254dd4-bb4f-40e5-97ef-9a102ebd3c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:12.051632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:12.097800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9254dd4-bb4f-40e5-97ef-9a102ebd3c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:12.100126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9254dd4-bb4f-40e5-97ef-9a102ebd3c91 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:12.215678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 618/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:42:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:42:12.221285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:12.241788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:12.338804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231596ac-b615-4695-9824-cb0ffd29bf69 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:12.377591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:12.378343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:12.378747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:12.379128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:12.392305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:12.394043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:12.411706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:12.412688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:12.413578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:12.413578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:12.413578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:12.413578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:12.413578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 597/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:12.419678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254dd4-bb4f-40e5-97ef-9a102ebd3c91 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:12.492220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:12.537876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254dd4-bb4f-40e5-97ef-9a102ebd3c91 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:12.576879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:12.577509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:12.577816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:12.578103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:12.578778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:12.579246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:12.580656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:12.593986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 619/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:12.599775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:12.682606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:12.722732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d08d93-28a0-459c-a0eb-1dccdc092f56 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:12.758406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:12.759003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:12.759286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:12.759559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:12.766207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:12.767671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:42:12.780586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:12.781654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:12.787732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 598/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:12.788357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:12.899565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92e33b-d377-49b5-b9e3-b549daef975a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:12.927692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:12.945512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff042a-872f-48af-9424-4c59c64ac841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:12.946144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff042a-872f-48af-9424-4c59c64ac841 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:12.946441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff042a-872f-48af-9424-4c59c64ac841 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:12.946709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff042a-872f-48af-9424-4c59c64ac841 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:12.947503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff042a-872f-48af-9424-4c59c64ac841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:12.947797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff042a-872f-48af-9424-4c59c64ac841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:12.949501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff042a-872f-48af-9424-4c59c64ac841 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:12.965408 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 620/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:12.971535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:13.076407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ae1d0-5a90-4782-a6fc-67d7e5933849 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:13.105356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:13.111641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dbbba-b39f-434c-b831-eb6d946f011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:13.112325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dbbba-b39f-434c-b831-eb6d946f011f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:13.112669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dbbba-b39f-434c-b831-eb6d946f011f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:13.113111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dbbba-b39f-434c-b831-eb6d946f011f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:13.113949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dbbba-b39f-434c-b831-eb6d946f011f None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=e98df09d65184729b62b2ae1904a27ff) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:13.114267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dbbba-b39f-434c-b831-eb6d946f011f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:13.116264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dbbba-b39f-434c-b831-eb6d946f011f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:13.122042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 599/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:42:12 2022] GET /identity/v3/role_assignments?user.id=e98df09d65184729b62b2ae1904a27ff&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:15.278509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7c8d3-9eac-4ea7-8fb3-d5e3817e4b38 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:15.278509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7c8d3-9eac-4ea7-8fb3-d5e3817e4b38 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:15.278509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7c8d3-9eac-4ea7-8fb3-d5e3817e4b38 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:15.279487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 621/1220] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:15.284524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa0878-32c8-4f11-9a1f-3c4bef1d73ea None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:15.285663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa0878-32c8-4f11-9a1f-3c4bef1d73ea None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:15.285663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa0878-32c8-4f11-9a1f-3c4bef1d73ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:15.306128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3bfa0878-32c8-4f11-9a1f-3c4bef1d73ea None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:15.307388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3bfa0878-32c8-4f11-9a1f-3c4bef1d73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:15.382507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 600/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:15.407311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7c8d3-9eac-4ea7-8fb3-d5e3817e4b38 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:15.525073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7c8d3-9eac-4ea7-8fb3-d5e3817e4b38 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:15.562172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58163d3-6ff0-4c97-9a62-aaf12d57f158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:15.562735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58163d3-6ff0-4c97-9a62-aaf12d57f158 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:15.563090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58163d3-6ff0-4c97-9a62-aaf12d57f158 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:15.563322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58163d3-6ff0-4c97-9a62-aaf12d57f158 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:15.574869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58163d3-6ff0-4c97-9a62-aaf12d57f158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-f58163d3-6ff0-4c97-9a62-aaf12d57f158 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:42:15.579785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:15.581091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:15.582091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 622/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:15.587998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa0878-32c8-4f11-9a1f-3c4bef1d73ea None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:15.694520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa0878-32c8-4f11-9a1f-3c4bef1d73ea None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:15.718190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:15.730120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:15.730766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:15.731120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:15.731391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:15.732158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:15.732466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:15.733904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:15.742857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 601/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:15.748979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58163d3-6ff0-4c97-9a62-aaf12d57f158 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:15.797496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:15.856470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58163d3-6ff0-4c97-9a62-aaf12d57f158 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:15.890121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:15.890852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:15.891235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:15.891511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:15.902696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:15.904262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:15.920124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:15.921276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:15.922244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:15.922244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:15.922244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:15.922244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:15.922244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 623/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:15.927456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:16.035059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98ba5f-42dd-449e-b78a-10200a2841a5 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:16.069669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:16.070288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:16.070573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:16.070848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:16.071572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:16.071878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:16.073242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:16.085906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 602/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:16.091763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:16.185714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:16.193050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea6d6e-c8b3-4360-8686-7e5893975ffa None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:16.226842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:16.227497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:16.227799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:16.228053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:16.235372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:16.236763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:42:16.247985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:16.249098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:16.250472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 624/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:42:16.255447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:16.305757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:16.363592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951d34-ab61-4b16-aeed-ee41631ca95f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:16.400781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:16.401408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:16.401690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:16.401967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:16.402762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:16.403102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:16.404559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:16.422056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 603/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jul 26 07:42:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:16.428087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:16.529200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775b555-a898-4f2a-9052-92933c65b4bf None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:16.567306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:16.568598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:16.568960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:16.569275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:16.583076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:16.584794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:16.603025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:16.603993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:16.605096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:16.605096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:16.605096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:16.605096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:16.605096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 625/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:16.610415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:16.717897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e37ec9-3a41-4d51-ac0a-8677fb2563c6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:16.720250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:16.756693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:16.757318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:16.757625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:16.757862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:16.758561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:16.758865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:16.760271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:16.772170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 604/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:16.778039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:16.789256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:16.895485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ae40-a216-43b3-8797-fb913be8b2b2 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:16.936593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:16.937325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:16.937628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:16.937898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:16.945688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:16.947353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:42:16.960201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:16.961240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:16.962166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 626/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:16.967934 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:17.078241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9556e61-d8b8-4969-b456-10191bf99d81 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:17.116445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5eb06-b88a-4ea0-a0fc-86f7c4d14094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:17.117123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5eb06-b88a-4ea0-a0fc-86f7c4d14094 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:17.117474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5eb06-b88a-4ea0-a0fc-86f7c4d14094 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:17.117781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5eb06-b88a-4ea0-a0fc-86f7c4d14094 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:17.118716 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5eb06-b88a-4ea0-a0fc-86f7c4d14094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:17.119090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5eb06-b88a-4ea0-a0fc-86f7c4d14094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:17.120675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5eb06-b88a-4ea0-a0fc-86f7c4d14094 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:17.133977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 605/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:17.140656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:17.211186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:17.249540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb87e8-8168-48a9-ac24-2f601c841fbf None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:17.287906 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63c8a7-8538-4b3f-b7b6-f1d598c08b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:17.288624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c8a7-8538-4b3f-b7b6-f1d598c08b39 None admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:17.288926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c8a7-8538-4b3f-b7b6-f1d598c08b39 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:17.289272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c8a7-8538-4b3f-b7b6-f1d598c08b39 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/e98df09d65184729b62b2ae1904a27ff/roles/a30240f5fb7d4b76a899eaed2f4cf878` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:17.304487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63c8a7-8538-4b3f-b7b6-f1d598c08b39 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=e98df09d65184729b62b2ae1904a27ff, role_id=a30240f5fb7d4b76a899eaed2f4cf878)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:17.305933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63c8a7-8538-4b3f-b7b6-f1d598c08b39 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:17.318033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 627/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:42:17 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/e98df09d65184729b62b2ae1904a27ff/roles/a30240f5fb7d4b76a899eaed2f4cf878 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:42:19.396054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071d24-bbc2-401c-9541-c1696be54a69 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:19.396760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071d24-bbc2-401c-9541-c1696be54a69 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:19.396760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071d24-bbc2-401c-9541-c1696be54a69 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:19.398092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 606/1233] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:19.403445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad32a8-a349-42c1-b056-dac6ccf47166 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:19.403903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad32a8-a349-42c1-b056-dac6ccf47166 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:19.403997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad32a8-a349-42c1-b056-dac6ccf47166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:19.421434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b7ad32a8-a349-42c1-b056-dac6ccf47166 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:19.422620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b7ad32a8-a349-42c1-b056-dac6ccf47166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:19.493796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 628/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:19.518805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28071d24-bbc2-401c-9541-c1696be54a69 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:19.544780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:19.637328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28071d24-bbc2-401c-9541-c1696be54a69 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:19.671980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d33664-ce17-4315-92a4-725c9c219c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:19.672622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33664-ce17-4315-92a4-725c9c219c53 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:19.672905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33664-ce17-4315-92a4-725c9c219c53 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:19.673179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33664-ce17-4315-92a4-725c9c219c53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:19.683781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d33664-ce17-4315-92a4-725c9c219c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-c0d33664-ce17-4315-92a4-725c9c219c53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:42:19.688820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:19.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:19.691332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 607/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jul 26 07:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:19.696768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad32a8-a349-42c1-b056-dac6ccf47166 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:19.747027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:19.805118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad32a8-a349-42c1-b056-dac6ccf47166 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:19.845327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:19.846140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:19.846519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:19.846829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:19.847613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] RBAC: Adding query filter params (name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:19.847925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:19.849795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:19.859188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 629/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jul 26 07:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:19.866437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d33664-ce17-4315-92a4-725c9c219c53 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:19.957284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:19.975831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d33664-ce17-4315-92a4-725c9c219c53 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:20.013219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:20.013917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:20.014202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:20.014490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:20.025415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:20.026883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:20.043829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:20.044916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:20.045976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:20.045976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:20.045976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:20.045976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:20.045976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 608/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:42:20.051169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:20.162293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734734f6-3301-42f1-bfe4-b98c9f028967 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:20.171284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:20.198207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:20.198886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:20.199221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:20.199524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:20.200296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:20.200614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:20.202060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:20.219812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 630/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:20.226258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:20.343164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947de84-8d19-48bc-a802-6150a100179d None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:20.381514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:20.382284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:20.382565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:20.382904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:20.386263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:20.392743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:20.394532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:42:20.407258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:20.408865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:20.409804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 609/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:20.414896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:20.525974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d85a37-66a9-48ff-acb6-a43e126a0433 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:20.564058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:20.565373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:20.565649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:20.565920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:20.566712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:20.567054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:20.568520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:20.592284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 631/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jul 26 07:42:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:20.598505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:20.709720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215d03a-1659-451a-a813-6676f5c10568 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:20.747906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b73ea-7105-4fb5-9651-7fb843a98a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:20.748588 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b73ea-7105-4fb5-9651-7fb843a98a9e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:20.748908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b73ea-7105-4fb5-9651-7fb843a98a9e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:20.749195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b73ea-7105-4fb5-9651-7fb843a98a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:20.819754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:20.827362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b73ea-7105-4fb5-9651-7fb843a98a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:20.829325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b73ea-7105-4fb5-9651-7fb843a98a9e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:20.948995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 610/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:42:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:42:20.955152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:20.985241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:21.066329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a3e83-3170-41d3-b34a-b43db330917b None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:21.102874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:21.103479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:21.103753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:21.104065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:21.115104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:21.116620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:21.133520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:21.134759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:21.136024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:21.136024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:21.136024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:21.136024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:21.136024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 632/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:21.144514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b73ea-7105-4fb5-9651-7fb843a98a9e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:21.246840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:21.256778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b73ea-7105-4fb5-9651-7fb843a98a9e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:21.295828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:21.296489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:21.296806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:21.297082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:21.297857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:21.298173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:21.299754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:21.312100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 611/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:42:21.318357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:21.408961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:21.433878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cd3aa-3c46-498d-bdf3-2b7ac1afc511 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:21.472759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:21.473464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:21.473795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:21.474076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:21.481999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:21.483755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:42:21.496350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:21.497445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:21.498692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:42:21.498692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:42:21.498692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:42:21.498692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:42:21.498692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:42:21.498692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:42:21.498692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:21.498692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:21.502718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 633/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:21.504075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:21.626952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c439-f466-4b7d-a0ed-3993c26d574c None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:21.666606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ec75c-cb99-4e96-a0fc-a763ed42e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:21.667186 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec75c-cb99-4e96-a0fc-a763ed42e53f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:21.667471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec75c-cb99-4e96-a0fc-a763ed42e53f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:21.667747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec75c-cb99-4e96-a0fc-a763ed42e53f None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:21.668510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ec75c-cb99-4e96-a0fc-a763ed42e53f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:21.668812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ec75c-cb99-4e96-a0fc-a763ed42e53f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:21.670240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ec75c-cb99-4e96-a0fc-a763ed42e53f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:21.683625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 612/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:21.690638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:21.801784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c2d01-6360-42b0-ba8e-44eb29396832 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:21.837312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409acf3-cdb4-4f00-af8f-aa10a385e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:21.837978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409acf3-cdb4-4f00-af8f-aa10a385e826 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:21.838258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409acf3-cdb4-4f00-af8f-aa10a385e826 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:21.838546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409acf3-cdb4-4f00-af8f-aa10a385e826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:21.839372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409acf3-cdb4-4f00-af8f-aa10a385e826 None admin] RBAC: Adding query filter params (role.id=a30240f5fb7d4b76a899eaed2f4cf878, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=e98df09d65184729b62b2ae1904a27ff) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:21.839689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409acf3-cdb4-4f00-af8f-aa10a385e826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:21.841624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409acf3-cdb4-4f00-af8f-aa10a385e826 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:21.850367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 634/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:42:21 2022] GET /identity/v3/role_assignments?user.id=e98df09d65184729b62b2ae1904a27ff&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=a30240f5fb7d4b76a899eaed2f4cf878 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:24.066008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11f85-81ad-494e-b6d0-9f27f58744e1 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:24.066637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11f85-81ad-494e-b6d0-9f27f58744e1 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:24.066637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11f85-81ad-494e-b6d0-9f27f58744e1 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:24.069044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 613/1247] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:24.075411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dd448-4639-4cc6-8a40-5d336d3cd48e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:24.075929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dd448-4639-4cc6-8a40-5d336d3cd48e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:24.076007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dd448-4639-4cc6-8a40-5d336d3cd48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:24.082755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:24.096695 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ab5dd448-4639-4cc6-8a40-5d336d3cd48e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:24.097986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ab5dd448-4639-4cc6-8a40-5d336d3cd48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:24.171862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 635/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:24.196946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11f85-81ad-494e-b6d0-9f27f58744e1 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:24.215991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:24.317906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11f85-81ad-494e-b6d0-9f27f58744e1 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:24.357111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43e88-1da2-4dba-9664-539dba3b23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:24.357753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43e88-1da2-4dba-9664-539dba3b23d6 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:24.358028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43e88-1da2-4dba-9664-539dba3b23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:24.358340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43e88-1da2-4dba-9664-539dba3b23d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:24.370087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd43e88-1da2-4dba-9664-539dba3b23d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-9bd43e88-1da2-4dba-9664-539dba3b23d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:42:24.375610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:24.376670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:42:24.377683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:24.382389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 614/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:42:24.383421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dd448-4639-4cc6-8a40-5d336d3cd48e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:24.491582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dd448-4639-4cc6-8a40-5d336d3cd48e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:24.525115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:24.530885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:24.531669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:24.532056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:24.532384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:24.533067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:24.533374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:24.534765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:24.544544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 636/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:42:24.550364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43e88-1da2-4dba-9664-539dba3b23d6 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:24.654767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:24.684762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43e88-1da2-4dba-9664-539dba3b23d6 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:24.724608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:24.725256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:24.725644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:24.725932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:24.738857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:24.740379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:24.757667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:24.758771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:24.759801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:24.759801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:24.759801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:24.759801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:24.759801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 615/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:24.765029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:24.875811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992aee-2ae2-4b03-9423-72a933944294 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:24.915350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:24.915889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:24.916174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:24.916449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:24.917139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:24.917444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:24.918798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:24.931489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 637/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:24.936866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:25.051763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79faf3-73f1-43fe-aa66-02d7e3901c59 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:25.081619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:25.091944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:25.092591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:25.092870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:25.093148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:25.102232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:25.103745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:42:25.115628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:25.116612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:25.117990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 616/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:25.122952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:25.186065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:25.239062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173b52-3a8c-4d5e-8c4b-d1549b09a0f6 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:25.281139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:25.281762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:25.282044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:25.282318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:25.283355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:25.283672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:25.285206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:25.304949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 638/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jul 26 07:42:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:25.310892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:25.427168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a6de-af21-4ae7-84cd-a5affe842cb1 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:25.467162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdfe3-648b-4de5-bf96-f33f8eaf255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:25.467712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdfe3-648b-4de5-bf96-f33f8eaf255f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:25.467997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdfe3-648b-4de5-bf96-f33f8eaf255f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:25.468274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdfe3-648b-4de5-bf96-f33f8eaf255f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:25.531177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:25.546196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bdfe3-648b-4de5-bf96-f33f8eaf255f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:25.548231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bdfe3-648b-4de5-bf96-f33f8eaf255f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:25.664650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 617/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:42:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:42:25.670515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:25.785278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4235-b074-46df-9f30-08551840d0d4 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:25.802715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:25.826416 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:25.827088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:25.827381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:25.827657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:25.838425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:25.839915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:25.860726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:25.861843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:25.862974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:25.862974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:25.862974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:25.862974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:25.862974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 639/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:42:25.868909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdfe3-648b-4de5-bf96-f33f8eaf255f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:25.964624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:25.980602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdfe3-648b-4de5-bf96-f33f8eaf255f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:26.016841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:26.017436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:26.017731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:26.018028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:26.018918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:26.019246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:26.020607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:26.039204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 618/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:26.040123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:26.147920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e189eb9-ca22-4882-b0d1-283f466610f1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:26.187357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:26.188273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:26.188620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:26.189053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:26.196707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:26.198146 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:42:26.213170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:26.214294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:26.215244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 640/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:26.220447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:26.333649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5f29c-3df1-4a4b-86f2-22d71b767547 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:26.369146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7739a8-a7a1-4745-8970-3719f436cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:26.369872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7739a8-a7a1-4745-8970-3719f436cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:26.370260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7739a8-a7a1-4745-8970-3719f436cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:26.370653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7739a8-a7a1-4745-8970-3719f436cfc2 None admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:26.371543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7739a8-a7a1-4745-8970-3719f436cfc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:26.371931 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7739a8-a7a1-4745-8970-3719f436cfc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:26.373630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7739a8-a7a1-4745-8970-3719f436cfc2 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:26.386454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 619/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:26.392562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:26.420079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:26.503963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf27e7a-7206-422e-b918-72968d7a7c00 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:26.542381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e82178-96bc-434b-ab71-7a543ea364bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:26.543040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82178-96bc-434b-ab71-7a543ea364bf None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:26.543376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82178-96bc-434b-ab71-7a543ea364bf None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:26.543671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82178-96bc-434b-ab71-7a543ea364bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:26.544501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82178-96bc-434b-ab71-7a543ea364bf None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=e98df09d65184729b62b2ae1904a27ff) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:26.544843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82178-96bc-434b-ab71-7a543ea364bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:26.546483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82178-96bc-434b-ab71-7a543ea364bf None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:26.553034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 641/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:42:26 2022] GET /identity/v3/role_assignments?user.id=e98df09d65184729b62b2ae1904a27ff&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=53894f3146884908ba6dd3e118397fb3 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:28.547454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf86d-49de-4390-8d51-e0a936cf8b04 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:28.547987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf86d-49de-4390-8d51-e0a936cf8b04 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:28.547987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf86d-49de-4390-8d51-e0a936cf8b04 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:28.549343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 620/1261] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:28.554453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ecea-e572-4caa-9aab-ce9d1d2744cf None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:28.554827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ecea-e572-4caa-9aab-ce9d1d2744cf None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:28.555054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ecea-e572-4caa-9aab-ce9d1d2744cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:28.573066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-55d9ecea-e572-4caa-9aab-ce9d1d2744cf None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:28.574378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-55d9ecea-e572-4caa-9aab-ce9d1d2744cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:28.650652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 642/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:28.673085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf86d-49de-4390-8d51-e0a936cf8b04 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:28.683747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:28.772728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf86d-49de-4390-8d51-e0a936cf8b04 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:28.804640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ebd40-4f68-49c9-ade6-d16a0cf823f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:28.805210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ebd40-4f68-49c9-ade6-d16a0cf823f8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:28.805495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ebd40-4f68-49c9-ade6-d16a0cf823f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:28.805769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ebd40-4f68-49c9-ade6-d16a0cf823f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:28.815642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ebd40-4f68-49c9-ade6-d16a0cf823f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-8e3ebd40-4f68-49c9-ade6-d16a0cf823f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:42:28.821135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:28.822190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:42:28.823230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:28.826988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 621/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:28.828012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9ecea-e572-4caa-9aab-ce9d1d2744cf None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:28.847609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:28.925304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9ecea-e572-4caa-9aab-ce9d1d2744cf None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:28.959629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:28.960662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:28.961110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:28.961544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:28.962347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:28.962658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:28.964043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:28.971884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 643/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:42:28.977540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ebd40-4f68-49c9-ade6-d16a0cf823f8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:29.042384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:29.075183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ebd40-4f68-49c9-ade6-d16a0cf823f8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:29.107242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:29.107864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:29.108147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:29.108423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:29.118664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:29.120236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:29.135926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:29.136982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:29.138179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:29.138179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:29.138179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:29.138179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:29.138179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 622/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:29.142659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:29.221316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:29.240630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ece18-2135-4a96-b552-909a4f5b77cf None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:29.272997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:29.273598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:29.273881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:29.274156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:29.274841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:29.275182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:29.276547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:29.288393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 644/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:29.293986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:29.391031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10806b12-4103-4c7a-bfad-87ebde9e5e6e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:29.409949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:29.424113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:29.424734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:29.425015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:29.425288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] PATH_INFO: `/v3/users/placement` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:29.433172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:29.434613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:42:29.446239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:29.447339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:29.448664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 623/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:29.453119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:29.548537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8faee-aa00-4679-a7db-7c7da28de8d1 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:29.582782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:29.583607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:29.583863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:29.584177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:29.585095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:29.585449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:29.587000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:29.604239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:29.615614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 645/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jul 26 07:42:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:29.621430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:29.717669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71e7d3-790f-44b0-a2aa-146d1cb29cfa None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:29.750352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:29.750999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:29.751285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:29.751560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:29.761696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:29.763155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:29.777169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:29.778189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:29.779375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:29.779375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:29.779375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:29.779375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:29.779375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 624/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:29.783746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:29.880789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff37c4-20a4-4d7c-a13a-6c4f1c9f0523 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:29.914298 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:29.914914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:29.915222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:29.915498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:29.916189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:29.916496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:29.917857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:29.928792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 646/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:29.934238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:29.965450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:30.033044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee3853-5668-400e-94a0-b527014b5f97 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:30.065461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:30.066093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:30.066376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:30.066654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:30.073100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:30.074531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:42:30.086108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:30.087177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:30.088097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 625/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:30.092941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:30.149398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:30.189754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784822f-4875-407f-b5ba-ce1dfb9ef3ac None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:30.222512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea8ee4-819a-4a26-a24f-8ecb2707dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:30.223136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea8ee4-819a-4a26-a24f-8ecb2707dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:30.223439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea8ee4-819a-4a26-a24f-8ecb2707dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:30.223711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea8ee4-819a-4a26-a24f-8ecb2707dfe9 None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:30.224445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea8ee4-819a-4a26-a24f-8ecb2707dfe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:30.224749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea8ee4-819a-4a26-a24f-8ecb2707dfe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:30.226160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea8ee4-819a-4a26-a24f-8ecb2707dfe9 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:30.237649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 647/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:30.243618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:30.331876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:30.341096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177af8a-b5b0-45a7-b2e7-46f1ad4ed1eb None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:30.372589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4c9f-1728-4fba-91f4-be60bdeba334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:30.373242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4c9f-1728-4fba-91f4-be60bdeba334 None admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:30.373520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4c9f-1728-4fba-91f4-be60bdeba334 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:30.373793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4c9f-1728-4fba-91f4-be60bdeba334 None admin] PATH_INFO: `/v3/projects/18140b27db544c5588e167b3ec29ca54/users/e98df09d65184729b62b2ae1904a27ff/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:30.375705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4c9f-1728-4fba-91f4-be60bdeba334 None admin] RBAC: Authorizing `identity:create_grant(project_id=18140b27db544c5588e167b3ec29ca54, user_id=e98df09d65184729b62b2ae1904a27ff, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:30.377121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4c9f-1728-4fba-91f4-be60bdeba334 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:30.389734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 626/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jul 26 07:42:30 2022] PUT /identity/v3/projects/18140b27db544c5588e167b3ec29ca54/users/e98df09d65184729b62b2ae1904a27ff/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:42:32.334718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a8be-3d1d-4b0e-b25f-3c2ccb613e14 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:32.335312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a8be-3d1d-4b0e-b25f-3c2ccb613e14 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:32.335312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339a8be-3d1d-4b0e-b25f-3c2ccb613e14 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:32.336678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 648/1274] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:32.341918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802507-fb1b-4f20-8281-71ec256d8ea5 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:32.342329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802507-fb1b-4f20-8281-71ec256d8ea5 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:32.342475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802507-fb1b-4f20-8281-71ec256d8ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:32.360653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f3802507-fb1b-4f20-8281-71ec256d8ea5 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:32.361823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f3802507-fb1b-4f20-8281-71ec256d8ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:32.425865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 627/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:32.449207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339a8be-3d1d-4b0e-b25f-3c2ccb613e14 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:32.549696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339a8be-3d1d-4b0e-b25f-3c2ccb613e14 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:32.567037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:32.586197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07c140-dbdf-4cfa-bd7b-c108095edf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:32.586876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c140-dbdf-4cfa-bd7b-c108095edf9a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:32.587309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c140-dbdf-4cfa-bd7b-c108095edf9a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:32.587510 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c140-dbdf-4cfa-bd7b-c108095edf9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:32.599701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07c140-dbdf-4cfa-bd7b-c108095edf9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-0e07c140-dbdf-4cfa-bd7b-c108095edf9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 07:42:32.605779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:32.607459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:32.608572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 649/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jul 26 07:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:32.613301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3802507-fb1b-4f20-8281-71ec256d8ea5 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:32.697644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:32.716218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3802507-fb1b-4f20-8281-71ec256d8ea5 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:32.750384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:32.751028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:32.751318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:32.751596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:32.752316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:32.752624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:32.753995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:32.762290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 628/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jul 26 07:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:42:32.768122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07c140-dbdf-4cfa-bd7b-c108095edf9a None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:32.872527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07c140-dbdf-4cfa-bd7b-c108095edf9a None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:32.907107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:32.907738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:32.908019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:32.908294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:32.919002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:32.920438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:32.935673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:32.936650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:32.937547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:32.937547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:32.937547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:32.937547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:32.937547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 650/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:32.943800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:33.041524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410449-d8ae-4d98-98d2-949bdf5c5ca8 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:33.074504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:33.075146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:33.075434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:33.075714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:33.076405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:33.076712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:33.078076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:33.090020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 629/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:42:33.095856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:33.126297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:33.194944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c6e30-a83c-4b5a-a73e-cc9805e59464 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:33.227669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:33.228290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:33.228575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:33.228849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:33.236056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:33.237495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 07:42:33.248638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:33.249779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:33.250921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 651/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:33.256178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:33.260004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:33.354159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05cc6c-f41b-4fe5-a760-d0901864822f None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:33.386678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:33.387255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:33.387539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:33.387815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:33.388614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:33.388923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:33.390345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:33.407415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 630/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jul 26 07:42:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:33.413166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:33.499580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:33.509657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b03293-4f22-49f2-8f9b-96ab01f1dc54 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:33.542209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ee38-d724-4c18-b55a-32ee150dcafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:33.542808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ee38-d724-4c18-b55a-32ee150dcafe None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:33.543123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ee38-d724-4c18-b55a-32ee150dcafe None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:33.543398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ee38-d724-4c18-b55a-32ee150dcafe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:33.615526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ee38-d724-4c18-b55a-32ee150dcafe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:33.617004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7ee38-d724-4c18-b55a-32ee150dcafe None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:33.703014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:33.713612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 652/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jul 26 07:42:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 07:42:33.719430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:33.779111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:33.816398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a480ed3-803f-47ef-ae6f-0b1ecc53c340 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:33.849809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:33.850447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:33.850728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:33.851033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:33.860875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:33.862307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 07:42:33.877884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:33.878956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:33.880534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 07:42:33.880534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 07:42:33.880534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 07:42:33.880534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:33.880534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 631/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:33.885267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ee38-d724-4c18-b55a-32ee150dcafe None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:33.979699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ee38-d724-4c18-b55a-32ee150dcafe None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:34.012703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:34.013299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:34.013577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:34.013848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:34.014519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:34.014819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:34.016205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:34.027181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 653/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jul 26 07:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:34.032742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:34.128122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d6eaf-4036-4c50-8aad-8a1eb406f997 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:34.140895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:34.161450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:34.162067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:34.162343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:34.162608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:34.169095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:34.170523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 07:42:34.182167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:34.183211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: ERROR keystone.server.flask.application Jul 26 07:42:34.184331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 632/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jul 26 07:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 07:42:34.189014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:34.236804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:34.285139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d76e4-e2fa-4321-b493-12983812f960 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:34.318085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4f085-69ae-4d93-bbca-b186940bc6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:34.318770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4f085-69ae-4d93-bbca-b186940bc6dc None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:34.319078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4f085-69ae-4d93-bbca-b186940bc6dc None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:34.319350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4f085-69ae-4d93-bbca-b186940bc6dc None admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:34.320093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4f085-69ae-4d93-bbca-b186940bc6dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:34.320399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4f085-69ae-4d93-bbca-b186940bc6dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:34.321821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4f085-69ae-4d93-bbca-b186940bc6dc None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:34.333804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 654/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jul 26 07:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:42:34.339721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:34.435875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7a98-ce5d-4453-847c-7a2f52b41b03 None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:34.467876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6d59-a933-45ba-8715-58a2bb955499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:34.468478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6d59-a933-45ba-8715-58a2bb955499 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:34.468760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6d59-a933-45ba-8715-58a2bb955499 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:34.469037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6d59-a933-45ba-8715-58a2bb955499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:34.469813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6d59-a933-45ba-8715-58a2bb955499 None admin] RBAC: Adding query filter params (role.id=53894f3146884908ba6dd3e118397fb3, scope.project.id=18140b27db544c5588e167b3ec29ca54, user.id=e98df09d65184729b62b2ae1904a27ff) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:34.470123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6d59-a933-45ba-8715-58a2bb955499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:34.471576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6d59-a933-45ba-8715-58a2bb955499 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:34.477691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 633/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jul 26 07:42:34 2022] GET /identity/v3/role_assignments?user.id=e98df09d65184729b62b2ae1904a27ff&scope.project.id=18140b27db544c5588e167b3ec29ca54&role.id=53894f3146884908ba6dd3e118397fb3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:36.465033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8467b-70d9-49ed-8771-08e5f163a153 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:36.465564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8467b-70d9-49ed-8771-08e5f163a153 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:36.465564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8467b-70d9-49ed-8771-08e5f163a153 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:36.466952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 655/1288] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:36.472056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef262a8-1b2b-4cce-92da-fd1e93bd8be9 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:36.472472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef262a8-1b2b-4cce-92da-fd1e93bd8be9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:36.472613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef262a8-1b2b-4cce-92da-fd1e93bd8be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:36.490164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-4ef262a8-1b2b-4cce-92da-fd1e93bd8be9 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:36.491372 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4ef262a8-1b2b-4cce-92da-fd1e93bd8be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:36.520872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:36.556943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 634/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:36.578899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8467b-70d9-49ed-8771-08e5f163a153 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:36.689586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8467b-70d9-49ed-8771-08e5f163a153 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:36.700411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:36.723013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:36.723621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:36.723901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:36.724172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:36.724797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:36.726152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:36.734713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:36.735949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:36.736803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 656/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:42:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:36.742430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef262a8-1b2b-4cce-92da-fd1e93bd8be9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:36.838920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef262a8-1b2b-4cce-92da-fd1e93bd8be9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:36.871838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002366c-1d45-43dd-bc70-d1fe8b902229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:36.872447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002366c-1d45-43dd-bc70-d1fe8b902229 None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:36.872725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002366c-1d45-43dd-bc70-d1fe8b902229 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:36.873000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002366c-1d45-43dd-bc70-d1fe8b902229 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:36.873675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002366c-1d45-43dd-bc70-d1fe8b902229 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:36.873978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002366c-1d45-43dd-bc70-d1fe8b902229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:36.875370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002366c-1d45-43dd-bc70-d1fe8b902229 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:36.880641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 635/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Tue Jul 26 07:42:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:42:36.886370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:36.983290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5a2c-d697-4535-8edf-eadf9209bf60 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:37.015484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6ab4b-871c-4aa9-96b8-44c171dd5c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:37.016086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ab4b-871c-4aa9-96b8-44c171dd5c3a None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:37.016366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ab4b-871c-4aa9-96b8-44c171dd5c3a None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:37.016639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ab4b-871c-4aa9-96b8-44c171dd5c3a None admin] PATH_INFO: `/v3/services` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:37.017305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6ab4b-871c-4aa9-96b8-44c171dd5c3a None admin] RBAC: Adding query filter params (type=placement) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:37.017610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6ab4b-871c-4aa9-96b8-44c171dd5c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:37.019258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6ab4b-871c-4aa9-96b8-44c171dd5c3a None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:37.023531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 657/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Tue Jul 26 07:42:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:38.967243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec8cb-93fd-4a94-ad19-56122e0bb1bf None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:38.967774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec8cb-93fd-4a94-ad19-56122e0bb1bf None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:38.967774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ec8cb-93fd-4a94-ad19-56122e0bb1bf None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:38.969130 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 636/1293] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:38.974737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd027-dce2-4f18-8dbe-691dbb0ea872 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:38.975148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd027-dce2-4f18-8dbe-691dbb0ea872 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:38.975329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd027-dce2-4f18-8dbe-691dbb0ea872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:38.992990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-cacfd027-dce2-4f18-8dbe-691dbb0ea872 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:38.994247 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cacfd027-dce2-4f18-8dbe-691dbb0ea872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:39.023267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:39.059738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 658/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:39.081037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec8cb-93fd-4a94-ad19-56122e0bb1bf None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:39.112585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:39.182531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ec8cb-93fd-4a94-ad19-56122e0bb1bf None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:39.216380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cd854-db25-4c10-841d-a3059e0e1768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:39.216989 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd854-db25-4c10-841d-a3059e0e1768 None admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:39.217278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd854-db25-4c10-841d-a3059e0e1768 None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:39.217557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd854-db25-4c10-841d-a3059e0e1768 None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:39.218259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cd854-db25-4c10-841d-a3059e0e1768 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:39.219656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cd854-db25-4c10-841d-a3059e0e1768 None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:39.233951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 637/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jul 26 07:42:39 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:42:41.221483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1f90-63b0-42f3-915c-e48d699489bc None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:41.222091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1f90-63b0-42f3-915c-e48d699489bc None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:41.222091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1f90-63b0-42f3-915c-e48d699489bc None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:41.223452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 659/1296] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:41.228421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea3847-9771-41be-8f07-b454ead3100e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:41.228827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea3847-9771-41be-8f07-b454ead3100e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:41.228974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea3847-9771-41be-8f07-b454ead3100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:41.247645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d1ea3847-9771-41be-8f07-b454ead3100e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:41.248823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d1ea3847-9771-41be-8f07-b454ead3100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:41.318490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 638/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:41.340058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1f90-63b0-42f3-915c-e48d699489bc None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:41.437572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1f90-63b0-42f3-915c-e48d699489bc None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:41.469864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:41.470485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:41.470760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:41.471052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:41.471720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:41.473023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:41.482128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:41.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:41.484496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 660/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:42:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:41.489958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea3847-9771-41be-8f07-b454ead3100e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:41.507583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:41.590786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea3847-9771-41be-8f07-b454ead3100e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:41.632475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:41.633185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:41.633515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:41.633843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:41.634599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] RBAC: Adding query filter params (name=placement) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:41.634976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:41.636638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:41.643277 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 639/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Tue Jul 26 07:42:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:42:41.650192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:41.686411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:41.752336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df06a3-826e-43af-94b9-7eae47fa7f81 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:41.783916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e3088-172c-4169-9739-c0a87916c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:41.784518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e3088-172c-4169-9739-c0a87916c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:41.784797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e3088-172c-4169-9739-c0a87916c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:41.785068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e3088-172c-4169-9739-c0a87916c2d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:41.786325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e3088-172c-4169-9739-c0a87916c2d4 None admin] RBAC: Adding query filter params (interface=public, service_id=105a8b19fd3741f48c281620389981f9, region_id=RegionOne) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:41.786634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e3088-172c-4169-9739-c0a87916c2d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:41.788011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e3088-172c-4169-9739-c0a87916c2d4 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:41.792814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 661/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jul 26 07:42:41 2022] GET /identity/v3/endpoints?service_id=105a8b19fd3741f48c281620389981f9&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:41.798351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:41.877766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:41.896356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7304ea8-dcb0-4e2c-9498-e6e8fcdff84e None admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:41.928787 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b89969-cb7d-40b4-b737-442ec533bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:41.929385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b89969-cb7d-40b4-b737-442ec533bfad None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:41.929665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b89969-cb7d-40b4-b737-442ec533bfad None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:41.929936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b89969-cb7d-40b4-b737-442ec533bfad None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:41.930584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b89969-cb7d-40b4-b737-442ec533bfad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:41.932017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b89969-cb7d-40b4-b737-442ec533bfad None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:41.938617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 640/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jul 26 07:42:41 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:42:43.891565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ddbc7-a337-42d8-957d-57b508747c18 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:43.892040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ddbc7-a337-42d8-957d-57b508747c18 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:43.892132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ddbc7-a337-42d8-957d-57b508747c18 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:43.893452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 662/1302] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:42:43.898821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b439c7-f255-490a-a8e8-d0ded25449e7 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:43.899270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b439c7-f255-490a-a8e8-d0ded25449e7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:43.899411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b439c7-f255-490a-a8e8-d0ded25449e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:43.917556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c3b439c7-f255-490a-a8e8-d0ded25449e7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:42:43.918734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c3b439c7-f255-490a-a8e8-d0ded25449e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:42:43.982814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 641/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:42:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 07:42:44.005448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ddbc7-a337-42d8-957d-57b508747c18 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:44.096529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:44.103797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ddbc7-a337-42d8-957d-57b508747c18 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:44.135423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:44.136040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:44.136317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:44.136585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:44.137196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:44.138552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 07:42:44.147918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 07:42:44.149079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application with Lock( Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self._enter() Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application return self.creator() Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application created_value = creator( Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: ERROR keystone.server.flask.application Jul 26 07:42:44.150116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 663/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jul 26 07:42:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 07:42:44.154915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b439c7-f255-490a-a8e8-d0ded25449e7 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:44.228226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:44.251238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b439c7-f255-490a-a8e8-d0ded25449e7 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:44.284363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817c4f-dd11-4aee-8573-ec6fb917b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:44.284973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817c4f-dd11-4aee-8573-ec6fb917b3ae None admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:44.285254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817c4f-dd11-4aee-8573-ec6fb917b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:44.285529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817c4f-dd11-4aee-8573-ec6fb917b3ae None admin] PATH_INFO: `/v3/services` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:44.286800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817c4f-dd11-4aee-8573-ec6fb917b3ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:42:44.287131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817c4f-dd11-4aee-8573-ec6fb917b3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:44.288494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817c4f-dd11-4aee-8573-ec6fb917b3ae None admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:44.293518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 642/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Tue Jul 26 07:42:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:42:44.299158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:42:44.397201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3779b99-2c82-4195-9787-0f49b04f43b0 None admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:42:44.429377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc14e7c-e53e-4c4c-b7d5-e880e9277a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:42:44.429976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc14e7c-e53e-4c4c-b7d5-e880e9277a40 None admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:42:44.430258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc14e7c-e53e-4c4c-b7d5-e880e9277a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:42:44.430535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc14e7c-e53e-4c4c-b7d5-e880e9277a40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:42:44.431262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc14e7c-e53e-4c4c-b7d5-e880e9277a40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:42:44.432620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc14e7c-e53e-4c4c-b7d5-e880e9277a40 None admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:42:44.451535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 664/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:42:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:42:54.290570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=30 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:42:54.448415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:46.304997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd45719-e443-4bd3-a6eb-6c3b2c7b4b09 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:46.306029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd45719-e443-4bd3-a6eb-6c3b2c7b4b09 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:46.306516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd45719-e443-4bd3-a6eb-6c3b2c7b4b09 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:46.311955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 643/1307] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:43:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:43:46.313328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380ae44-5ccb-486a-90cf-639edff315e6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:46.313767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380ae44-5ccb-486a-90cf-639edff315e6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:46.313968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380ae44-5ccb-486a-90cf-639edff315e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:46.393284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-7380ae44-5ccb-486a-90cf-639edff315e6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:43:46.395655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7380ae44-5ccb-486a-90cf-639edff315e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:46.503904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 665/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:43:46.554100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3692-8a19-4a4c-afc3-cf3b5f7582c8 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:46.554399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3692-8a19-4a4c-afc3-cf3b5f7582c8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:46.554631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3692-8a19-4a4c-afc3-cf3b5f7582c8 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:46.556211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 644/1309] 10.222.0.46 () {54 vars in 965 bytes} [Tue Jul 26 07:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:43:46.562663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193c328-2690-4e44-ab0f-e74f1612192d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:46.562984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193c328-2690-4e44-ab0f-e74f1612192d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:46.563216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193c328-2690-4e44-ab0f-e74f1612192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:46.662831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c193c328-2690-4e44-ab0f-e74f1612192d None None] MFA Rules not processed for user `77a234b8e5f2472cb3e733f933ca1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:43:46.664233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c193c328-2690-4e44-ab0f-e74f1612192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:46.688712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:46.765446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 666/1310] 10.222.0.46 () {58 vars in 1062 bytes} [Tue Jul 26 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:43:46.774965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3692-8a19-4a4c-afc3-cf3b5f7582c8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:43:46.776713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5bfd3692-8a19-4a4c-afc3-cf3b5f7582c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:46.918732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3692-8a19-4a4c-afc3-cf3b5f7582c8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:43:46.994423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cbac0-8a9e-4e37-91ed-af56768fd19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:43:46.995178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cbac0-8a9e-4e37-91ed-af56768fd19f service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:46.995549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cbac0-8a9e-4e37-91ed-af56768fd19f service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:46.995895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cbac0-8a9e-4e37-91ed-af56768fd19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:46.997657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-dd1cbac0-8a9e-4e37-91ed-af56768fd19f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:47.054305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:47.113817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cbac0-8a9e-4e37-91ed-af56768fd19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:43:47.115459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cbac0-8a9e-4e37-91ed-af56768fd19f service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:43:47.135689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 645/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:43:49.451571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be03f1-1079-44bb-adc0-7102e230ff28 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:49.452098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be03f1-1079-44bb-adc0-7102e230ff28 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:49.452098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be03f1-1079-44bb-adc0-7102e230ff28 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:49.457807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 667/1312] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:43:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:43:49.459370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d92c6-bf4e-413f-a272-36ddf02d8657 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:49.459813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d92c6-bf4e-413f-a272-36ddf02d8657 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:49.459982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d92c6-bf4e-413f-a272-36ddf02d8657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:49.546914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-227d92c6-bf4e-413f-a272-36ddf02d8657 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:43:49.548394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-227d92c6-bf4e-413f-a272-36ddf02d8657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:49.654979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 646/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:43:49.694168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be03f1-1079-44bb-adc0-7102e230ff28 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:43:49.695809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a4be03f1-1079-44bb-adc0-7102e230ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:49.808732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be03f1-1079-44bb-adc0-7102e230ff28 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:43:49.889997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:49.893607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c8e4d-9bae-4bcf-8a7d-7f056e49c891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:43:49.895170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8e4d-9bae-4bcf-8a7d-7f056e49c891 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:49.895822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8e4d-9bae-4bcf-8a7d-7f056e49c891 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:49.896621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8e4d-9bae-4bcf-8a7d-7f056e49c891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:49.898660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bb4c8e4d-9bae-4bcf-8a7d-7f056e49c891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:50.026749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c8e4d-9bae-4bcf-8a7d-7f056e49c891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:43:50.028354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c8e4d-9bae-4bcf-8a7d-7f056e49c891 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:43:50.050878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 668/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:43:52.339915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1296-4a25-4daa-be82-8ef8ef1046d0 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:52.340408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1296-4a25-4daa-be82-8ef8ef1046d0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:52.340500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1296-4a25-4daa-be82-8ef8ef1046d0 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:52.341837 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 647/1315] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:43:52.346827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e72844-8434-45ef-8bcf-a5bae4e1c06d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:52.347798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e72844-8434-45ef-8bcf-a5bae4e1c06d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:52.347988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e72844-8434-45ef-8bcf-a5bae4e1c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:52.413674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-74e72844-8434-45ef-8bcf-a5bae4e1c06d None None] MFA Rules not processed for user `c7c7587f428b4eecaea47868f0004d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:43:52.414892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-74e72844-8434-45ef-8bcf-a5bae4e1c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:52.465272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:52.509539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 669/1316] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:43:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:43:52.549472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1296-4a25-4daa-be82-8ef8ef1046d0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:43:52.551049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0e1d1296-4a25-4daa-be82-8ef8ef1046d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:52.560718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:52.656344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1296-4a25-4daa-be82-8ef8ef1046d0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:43:52.727476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6bb6f-7992-47d3-a0db-66664dcface7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:43:52.728085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6bb6f-7992-47d3-a0db-66664dcface7 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:52.728364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6bb6f-7992-47d3-a0db-66664dcface7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:52.728633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6bb6f-7992-47d3-a0db-66664dcface7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:52.730262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-58d6bb6f-7992-47d3-a0db-66664dcface7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:52.789903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:52.837213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6bb6f-7992-47d3-a0db-66664dcface7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:43:52.838589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6bb6f-7992-47d3-a0db-66664dcface7 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:43:52.857691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 648/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:43:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:43:55.379878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cb2c2-e415-42e8-b3b3-94b8c9f830b6 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:55.380410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cb2c2-e415-42e8-b3b3-94b8c9f830b6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:55.380410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cb2c2-e415-42e8-b3b3-94b8c9f830b6 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:55.381790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 670/1318] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:43:55.386923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01329-82ce-457f-a72d-393d8a30d323 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:55.387368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01329-82ce-457f-a72d-393d8a30d323 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:55.387515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a01329-82ce-457f-a72d-393d8a30d323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:55.452157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a5a01329-82ce-457f-a72d-393d8a30d323 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:43:55.453379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a5a01329-82ce-457f-a72d-393d8a30d323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:55.547289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 649/1319] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:43:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:43:55.587090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cb2c2-e415-42e8-b3b3-94b8c9f830b6 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:43:55.588567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b22cb2c2-e415-42e8-b3b3-94b8c9f830b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:55.690106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cb2c2-e415-42e8-b3b3-94b8c9f830b6 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:43:55.761756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15b566-ebeb-4cf9-8547-79cb9a3e9493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:43:55.762371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b566-ebeb-4cf9-8547-79cb9a3e9493 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:55.762654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b566-ebeb-4cf9-8547-79cb9a3e9493 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:55.762948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15b566-ebeb-4cf9-8547-79cb9a3e9493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:55.764570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ec15b566-ebeb-4cf9-8547-79cb9a3e9493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:55.772121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:55.872864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15b566-ebeb-4cf9-8547-79cb9a3e9493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:43:55.874310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15b566-ebeb-4cf9-8547-79cb9a3e9493 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:43:55.892025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 671/1320] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:43:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:43:58.496677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e716-d0fc-4c37-a242-7df0d58bc0f3 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:58.497202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e716-d0fc-4c37-a242-7df0d58bc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:58.497316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e716-d0fc-4c37-a242-7df0d58bc0f3 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:58.498600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 650/1321] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:43:58.504328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa5328-6d1f-476c-b78e-4bd38d738108 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:58.504731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa5328-6d1f-476c-b78e-4bd38d738108 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:58.504958 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa5328-6d1f-476c-b78e-4bd38d738108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:58.570806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-40aa5328-6d1f-476c-b78e-4bd38d738108 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:43:58.571976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-40aa5328-6d1f-476c-b78e-4bd38d738108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:58.632157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:58.671545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 672/1322] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:43:58.708656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e716-d0fc-4c37-a242-7df0d58bc0f3 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:43:58.710228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-85d7e716-d0fc-4c37-a242-7df0d58bc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:58.731799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:58.821386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e716-d0fc-4c37-a242-7df0d58bc0f3 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:43:58.900251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d81e60-dd5a-4e09-a265-4484d6c08cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:43:58.900916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81e60-dd5a-4e09-a265-4484d6c08cda service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:43:58.901205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81e60-dd5a-4e09-a265-4484d6c08cda service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:43:58.901487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81e60-dd5a-4e09-a265-4484d6c08cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:43:58.903172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-73d81e60-dd5a-4e09-a265-4484d6c08cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:43:58.974673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:43:59.012375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d81e60-dd5a-4e09-a265-4484d6c08cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:43:59.013803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d81e60-dd5a-4e09-a265-4484d6c08cda service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:43:59.031495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 651/1323] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:01.068463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31716-5f0f-4595-a0e7-f50382adadce None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:01.068994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31716-5f0f-4595-a0e7-f50382adadce None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:01.068994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31716-5f0f-4595-a0e7-f50382adadce None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:01.070395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 673/1324] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:01.075629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc6b5-1439-49c4-b044-6cc65920dc12 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:01.076051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc6b5-1439-49c4-b044-6cc65920dc12 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:01.076407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc6b5-1439-49c4-b044-6cc65920dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:01.141188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a65bc6b5-1439-49c4-b044-6cc65920dc12 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:01.142279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a65bc6b5-1439-49c4-b044-6cc65920dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:01.236167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 652/1325] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:01.272639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af31716-5f0f-4595-a0e7-f50382adadce None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:01.274167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9af31716-5f0f-4595-a0e7-f50382adadce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:01.378999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af31716-5f0f-4595-a0e7-f50382adadce None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:01.450709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fd548-f60c-450c-a890-966a8d33a94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:01.451361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd548-f60c-450c-a890-966a8d33a94c service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:01.451641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd548-f60c-450c-a890-966a8d33a94c service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:01.451913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fd548-f60c-450c-a890-966a8d33a94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:01.453552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-767fd548-f60c-450c-a890-966a8d33a94c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:01.470098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:01.565067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fd548-f60c-450c-a890-966a8d33a94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:01.567174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fd548-f60c-450c-a890-966a8d33a94c service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:01.587036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 674/1326] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:03.616525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7647-916c-4e02-ac92-6fd55bfd5466 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:03.617058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7647-916c-4e02-ac92-6fd55bfd5466 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:03.617058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7647-916c-4e02-ac92-6fd55bfd5466 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:03.618428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 653/1327] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:03.623620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45fd6-fab1-4461-b55c-8b01ba7ff69a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:03.624065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45fd6-fab1-4461-b55c-8b01ba7ff69a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:03.624202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45fd6-fab1-4461-b55c-8b01ba7ff69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:03.696319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-daa45fd6-fab1-4461-b55c-8b01ba7ff69a None None] MFA Rules not processed for user `c7c7587f428b4eecaea47868f0004d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:03.697591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-daa45fd6-fab1-4461-b55c-8b01ba7ff69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:03.762199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:03.794378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 675/1328] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:03.847126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650269d6-130d-4497-8d27-2722a20a975c None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:03.847126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650269d6-130d-4497-8d27-2722a20a975c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:03.847126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650269d6-130d-4497-8d27-2722a20a975c None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:03.848483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 654/1329] 10.222.0.46 () {54 vars in 965 bytes} [Tue Jul 26 07:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:03.854669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880ed11-93c1-45da-bb60-2c4cb22f682f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:03.854997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880ed11-93c1-45da-bb60-2c4cb22f682f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:03.855359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880ed11-93c1-45da-bb60-2c4cb22f682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:03.934553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-6880ed11-93c1-45da-bb60-2c4cb22f682f None None] MFA Rules not processed for user `77a234b8e5f2472cb3e733f933ca1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:03.935799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6880ed11-93c1-45da-bb60-2c4cb22f682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:04.016038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 676/1330] 10.222.0.46 () {58 vars in 1062 bytes} [Tue Jul 26 07:44:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:04.025207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650269d6-130d-4497-8d27-2722a20a975c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:04.026707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-650269d6-130d-4497-8d27-2722a20a975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:04.057436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:04.130795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650269d6-130d-4497-8d27-2722a20a975c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:04.205639 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6350-07c7-4459-8635-90a89145b047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:04.206392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6350-07c7-4459-8635-90a89145b047 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:04.206677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6350-07c7-4459-8635-90a89145b047 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:04.206975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6350-07c7-4459-8635-90a89145b047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:04.208632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b62f6350-07c7-4459-8635-90a89145b047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:04.286714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:04.319058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f6350-07c7-4459-8635-90a89145b047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:04.320511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f6350-07c7-4459-8635-90a89145b047 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:04.339377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 655/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:06.992582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3732d0-4569-40c2-816e-99f6c6369e8a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:06.993109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3732d0-4569-40c2-816e-99f6c6369e8a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:06.993109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3732d0-4569-40c2-816e-99f6c6369e8a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:06.994482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 677/1332] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:06.999672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309b95f-ddc4-4a74-b671-fa07ae5e3e48 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:07.000114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309b95f-ddc4-4a74-b671-fa07ae5e3e48 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:07.000241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309b95f-ddc4-4a74-b671-fa07ae5e3e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:07.064899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5309b95f-ddc4-4a74-b671-fa07ae5e3e48 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:07.066142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5309b95f-ddc4-4a74-b671-fa07ae5e3e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:07.160150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 656/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:07.196051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3732d0-4569-40c2-816e-99f6c6369e8a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:07.197574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ee3732d0-4569-40c2-816e-99f6c6369e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:07.265739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:07.299845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3732d0-4569-40c2-816e-99f6c6369e8a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:07.371759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ce49f-298d-4cdd-a303-c52c4aad28b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:07.372368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ce49f-298d-4cdd-a303-c52c4aad28b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:07.372647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ce49f-298d-4cdd-a303-c52c4aad28b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:07.372919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ce49f-298d-4cdd-a303-c52c4aad28b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:07.374557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bb1ce49f-298d-4cdd-a303-c52c4aad28b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:07.479797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ce49f-298d-4cdd-a303-c52c4aad28b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:07.481158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ce49f-298d-4cdd-a303-c52c4aad28b0 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:07.491477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:07.499821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 678/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:09.542716 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206e8fb-06ba-4a4c-8d0b-d658ed78c7c8 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:09.543281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206e8fb-06ba-4a4c-8d0b-d658ed78c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:09.543281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206e8fb-06ba-4a4c-8d0b-d658ed78c7c8 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:09.544649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 657/1335] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:09.549928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e085-e8ab-4692-b8f4-75d9839b7e2a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:09.550364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e085-e8ab-4692-b8f4-75d9839b7e2a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:09.550499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e085-e8ab-4692-b8f4-75d9839b7e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:09.616562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-0673e085-e8ab-4692-b8f4-75d9839b7e2a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:09.617778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0673e085-e8ab-4692-b8f4-75d9839b7e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:09.713424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 679/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:09.753592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206e8fb-06ba-4a4c-8d0b-d658ed78c7c8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:09.755175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c206e8fb-06ba-4a4c-8d0b-d658ed78c7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:09.794475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:09.856377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206e8fb-06ba-4a4c-8d0b-d658ed78c7c8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:09.928249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e7da2-2e16-437f-beb9-f7d600799d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:09.928860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7da2-2e16-437f-beb9-f7d600799d2d service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:09.929141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7da2-2e16-437f-beb9-f7d600799d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:09.929416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7da2-2e16-437f-beb9-f7d600799d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:09.931069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-360e7da2-2e16-437f-beb9-f7d600799d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:10.011296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:10.037668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e7da2-2e16-437f-beb9-f7d600799d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:10.039133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e7da2-2e16-437f-beb9-f7d600799d2d service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:10.056952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 658/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:12.509374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1894fc-e0e8-4562-ac3f-8d9f602a94bd None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:12.509930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1894fc-e0e8-4562-ac3f-8d9f602a94bd None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:12.509930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1894fc-e0e8-4562-ac3f-8d9f602a94bd None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:12.511323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 680/1338] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:12.516494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b29d-4643-45df-a31f-c84841d63017 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:12.516879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b29d-4643-45df-a31f-c84841d63017 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:12.517050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b29d-4643-45df-a31f-c84841d63017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:12.583436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-4717b29d-4643-45df-a31f-c84841d63017 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:12.584788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4717b29d-4643-45df-a31f-c84841d63017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:12.679151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 659/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:44:12.714294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1894fc-e0e8-4562-ac3f-8d9f602a94bd None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:12.715865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0f1894fc-e0e8-4562-ac3f-8d9f602a94bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:12.790063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:12.817646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1894fc-e0e8-4562-ac3f-8d9f602a94bd None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:12.890494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3dcc4-bf3f-4052-8628-827f03dc7b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:12.891140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3dcc4-bf3f-4052-8628-827f03dc7b69 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:12.891422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3dcc4-bf3f-4052-8628-827f03dc7b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:12.891689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3dcc4-bf3f-4052-8628-827f03dc7b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:12.893304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-13b3dcc4-bf3f-4052-8628-827f03dc7b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:12.999050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3dcc4-bf3f-4052-8628-827f03dc7b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:13.000486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3dcc4-bf3f-4052-8628-827f03dc7b69 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:13.017925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 681/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:16.917529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec162c-61ff-4153-a6d6-0b48b6b4735b None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:16.918204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec162c-61ff-4153-a6d6-0b48b6b4735b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:16.918204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec162c-61ff-4153-a6d6-0b48b6b4735b None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:16.919811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 660/1341] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:16.925129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6c1a-fc6c-42a8-824c-6e2ac3b8ca6b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:16.925609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6c1a-fc6c-42a8-824c-6e2ac3b8ca6b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:16.925716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6c1a-fc6c-42a8-824c-6e2ac3b8ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:16.936220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:16.994873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f28b6c1a-fc6c-42a8-824c-6e2ac3b8ca6b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:16.996050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f28b6c1a-fc6c-42a8-824c-6e2ac3b8ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:17.097223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 682/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:17.136124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec162c-61ff-4153-a6d6-0b48b6b4735b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:17.137759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b9ec162c-61ff-4153-a6d6-0b48b6b4735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:17.189828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:17.246712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec162c-61ff-4153-a6d6-0b48b6b4735b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:17.319456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c473d-609d-4828-9051-9c0797443f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:17.320071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c473d-609d-4828-9051-9c0797443f20 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:17.320349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c473d-609d-4828-9051-9c0797443f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:17.320619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c473d-609d-4828-9051-9c0797443f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:17.322222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-844c473d-609d-4828-9051-9c0797443f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:17.418418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:17.435600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c473d-609d-4828-9051-9c0797443f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:17.437070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c473d-609d-4828-9051-9c0797443f20 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:17.455943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 661/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:20.033173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e0ab9-9e26-482a-97b9-193b4f95f77a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:20.033718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e0ab9-9e26-482a-97b9-193b4f95f77a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:20.033718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e0ab9-9e26-482a-97b9-193b4f95f77a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:20.035124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 683/1344] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:20.041367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b753a-a660-442a-8643-fb56f9d64547 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:20.041887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b753a-a660-442a-8643-fb56f9d64547 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:20.042081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b753a-a660-442a-8643-fb56f9d64547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:20.114246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8f2b753a-a660-442a-8643-fb56f9d64547 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:20.115456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8f2b753a-a660-442a-8643-fb56f9d64547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:20.216656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 662/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:20.254106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e0ab9-9e26-482a-97b9-193b4f95f77a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:20.255676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8f5e0ab9-9e26-482a-97b9-193b4f95f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:20.347639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:20.366171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e0ab9-9e26-482a-97b9-193b4f95f77a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:20.439584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e9da5-f3dc-4744-a326-b7002d49eed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:20.440210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9da5-f3dc-4744-a326-b7002d49eed7 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:20.440492 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9da5-f3dc-4744-a326-b7002d49eed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:20.440769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9da5-f3dc-4744-a326-b7002d49eed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:20.442435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a21e9da5-f3dc-4744-a326-b7002d49eed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:20.554858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e9da5-f3dc-4744-a326-b7002d49eed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:20.556436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e9da5-f3dc-4744-a326-b7002d49eed7 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:20.574031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 684/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:24.543789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c361-f288-49f9-ab27-704c611cfc57 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:24.544205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c361-f288-49f9-ab27-704c611cfc57 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:24.544345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c361-f288-49f9-ab27-704c611cfc57 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:24.545708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 663/1347] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:24.550797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a0841-2b33-412d-91fb-570326a0ff1d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:24.551385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a0841-2b33-412d-91fb-570326a0ff1d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:24.551487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a0841-2b33-412d-91fb-570326a0ff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:24.567726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:24.622994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ff3a0841-2b33-412d-91fb-570326a0ff1d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:24.624214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ff3a0841-2b33-412d-91fb-570326a0ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:24.736407 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 685/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:24.774435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4c361-f288-49f9-ab27-704c611cfc57 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:24.776158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4db4c361-f288-49f9-ab27-704c611cfc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:24.837512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:24.888067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4c361-f288-49f9-ab27-704c611cfc57 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:24.965810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb830e-09fc-4691-95ad-ea12ffda59a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:24.966442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb830e-09fc-4691-95ad-ea12ffda59a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:24.966724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb830e-09fc-4691-95ad-ea12ffda59a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:24.967035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb830e-09fc-4691-95ad-ea12ffda59a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:24.968717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c6eb830e-09fc-4691-95ad-ea12ffda59a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:25.077874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:25.082967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb830e-09fc-4691-95ad-ea12ffda59a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:25.084692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb830e-09fc-4691-95ad-ea12ffda59a5 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:25.103975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 664/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:29.965333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf1cf-6bd4-439c-883f-fd3712c02abd None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:29.965831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf1cf-6bd4-439c-883f-fd3712c02abd None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:29.966311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf1cf-6bd4-439c-883f-fd3712c02abd None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:29.968075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 686/1350] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:29.973736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24b10-1a5b-4629-b9dc-c4567f593aae None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:29.974176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24b10-1a5b-4629-b9dc-c4567f593aae None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:29.974367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24b10-1a5b-4629-b9dc-c4567f593aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:30.096155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-99b24b10-1a5b-4629-b9dc-c4567f593aae None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:30.098532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-99b24b10-1a5b-4629-b9dc-c4567f593aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:30.235788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 665/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:44:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:34.304082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e1bd-2abc-400f-9426-95882f836d2b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:34.305618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e1bd-2abc-400f-9426-95882f836d2b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:34.306200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e1bd-2abc-400f-9426-95882f836d2b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:34.308172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 687/1352] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:44:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:34.315438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d317b-cbe8-4e98-816e-a697d3df265b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:34.315913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d317b-cbe8-4e98-816e-a697d3df265b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:34.315913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d317b-cbe8-4e98-816e-a697d3df265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:34.369853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:34.394449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-338d317b-cbe8-4e98-816e-a697d3df265b None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:34.396578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-338d317b-cbe8-4e98-816e-a697d3df265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:34.515765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 666/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:44:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:34.734512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=59 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:35.934903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24d16-cf95-4481-9df9-52d18d73327a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:35.935537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24d16-cf95-4481-9df9-52d18d73327a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:35.935537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24d16-cf95-4481-9df9-52d18d73327a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:35.937262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 688/1354] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:35.943045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ce56-0af8-4436-90e0-47fdb0d8ce6f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:35.943476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ce56-0af8-4436-90e0-47fdb0d8ce6f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:35.943729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ce56-0af8-4436-90e0-47fdb0d8ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:36.018246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0323ce56-0af8-4436-90e0-47fdb0d8ce6f None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:36.020352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0323ce56-0af8-4436-90e0-47fdb0d8ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:36.062092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:36.136453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 667/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:44:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:39.340000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393533f2-2553-410b-8437-c3eb5ae16fb2 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:39.340520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393533f2-2553-410b-8437-c3eb5ae16fb2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:39.340520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393533f2-2553-410b-8437-c3eb5ae16fb2 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:39.341817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 689/1356] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:39.347297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f68dc-19a9-416b-869c-b485780f015d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:39.348339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f68dc-19a9-416b-869c-b485780f015d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:39.348548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f68dc-19a9-416b-869c-b485780f015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:39.427299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-de8f68dc-19a9-416b-869c-b485780f015d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:39.428541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-de8f68dc-19a9-416b-869c-b485780f015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:39.534268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 668/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:39.591137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bee41-b6dd-44fd-a054-8bdf5b16cf44 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:39.591765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bee41-b6dd-44fd-a054-8bdf5b16cf44 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:39.592246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bee41-b6dd-44fd-a054-8bdf5b16cf44 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:39.594055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 690/1358] 10.222.0.46 () {54 vars in 962 bytes} [Tue Jul 26 07:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:39.602671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df89e-7454-4c01-8273-797b101b364e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:39.603299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df89e-7454-4c01-8273-797b101b364e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:39.603665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18df89e-7454-4c01-8273-797b101b364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:39.626249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:39.689982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a18df89e-7454-4c01-8273-797b101b364e None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:39.691889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a18df89e-7454-4c01-8273-797b101b364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:39.810260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 669/1359] 10.222.0.46 () {58 vars in 1059 bytes} [Tue Jul 26 07:44:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:44:39.818476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bee41-b6dd-44fd-a054-8bdf5b16cf44 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:39.820009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9d8bee41-b6dd-44fd-a054-8bdf5b16cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:39.970809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bee41-b6dd-44fd-a054-8bdf5b16cf44 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:40.048579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:40.095356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3543f-167b-487a-930e-8295385c7a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:40.095893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3543f-167b-487a-930e-8295385c7a4f service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:40.096175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3543f-167b-487a-930e-8295385c7a4f service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:40.096447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3543f-167b-487a-930e-8295385c7a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:40.098142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3bf3543f-167b-487a-930e-8295385c7a4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:40.192921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3543f-167b-487a-930e-8295385c7a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:40.194517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3543f-167b-487a-930e-8295385c7a4f service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:40.213541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 691/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:42.445566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9bb1-53d7-45a3-947a-dd1f820ab523 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:42.446134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9bb1-53d7-45a3-947a-dd1f820ab523 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:42.446134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9bb1-53d7-45a3-947a-dd1f820ab523 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:42.447536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 670/1361] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:42.452978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b3edc-6edc-4fc7-9621-53fb167cf19f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:42.453387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b3edc-6edc-4fc7-9621-53fb167cf19f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:42.453481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b3edc-6edc-4fc7-9621-53fb167cf19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:42.522405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9d8b3edc-6edc-4fc7-9621-53fb167cf19f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:42.523642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9d8b3edc-6edc-4fc7-9621-53fb167cf19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:42.563717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:42.632833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 692/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:42.679196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9bb1-53d7-45a3-947a-dd1f820ab523 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:42.680817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9cbd9bb1-53d7-45a3-947a-dd1f820ab523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:42.758581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:42.845860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9bb1-53d7-45a3-947a-dd1f820ab523 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:42.972736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079151b-9c62-4321-b0c9-d57bc82e66f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:42.973363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079151b-9c62-4321-b0c9-d57bc82e66f3 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:42.973650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079151b-9c62-4321-b0c9-d57bc82e66f3 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:42.973929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079151b-9c62-4321-b0c9-d57bc82e66f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:42.975685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f079151b-9c62-4321-b0c9-d57bc82e66f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:43.001944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:43.074571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079151b-9c62-4321-b0c9-d57bc82e66f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:43.076228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079151b-9c62-4321-b0c9-d57bc82e66f3 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:43.094971 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 671/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:45.445934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5d0a-e912-4394-ad89-5ba2aaa835a6 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:45.446869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5d0a-e912-4394-ad89-5ba2aaa835a6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:45.447184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5d0a-e912-4394-ad89-5ba2aaa835a6 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:45.448694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 693/1364] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:45.454143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3937-600b-4fb5-9e4a-6e2cbff33c79 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:45.454613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3937-600b-4fb5-9e4a-6e2cbff33c79 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:45.454717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3937-600b-4fb5-9e4a-6e2cbff33c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:45.532576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-bd8e3937-600b-4fb5-9e4a-6e2cbff33c79 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:45.533807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-bd8e3937-600b-4fb5-9e4a-6e2cbff33c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:45.649916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:45.654976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 672/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:45.699786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d4b92-0df4-440a-880b-6c77507485dc None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:45.700393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d4b92-0df4-440a-880b-6c77507485dc None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:45.700781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d4b92-0df4-440a-880b-6c77507485dc None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:45.702247 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 694/1366] 10.222.0.46 () {54 vars in 962 bytes} [Tue Jul 26 07:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:45.708630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22a3a-03ef-4c42-997b-9a3a1f6dff8c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:45.708966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22a3a-03ef-4c42-997b-9a3a1f6dff8c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:45.709246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22a3a-03ef-4c42-997b-9a3a1f6dff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:45.792644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-2fd22a3a-03ef-4c42-997b-9a3a1f6dff8c None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:45.793377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2fd22a3a-03ef-4c42-997b-9a3a1f6dff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:45.921260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 673/1367] 10.222.0.46 () {58 vars in 1059 bytes} [Tue Jul 26 07:44:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:45.929735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d4b92-0df4-440a-880b-6c77507485dc None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:45.931278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-078d4b92-0df4-440a-880b-6c77507485dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:46.088320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d4b92-0df4-440a-880b-6c77507485dc None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:46.109004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:46.210135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df6fb1-dc83-4cce-9ff1-898cc4f14967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:46.210758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6fb1-dc83-4cce-9ff1-898cc4f14967 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:46.211067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6fb1-dc83-4cce-9ff1-898cc4f14967 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:46.211344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6fb1-dc83-4cce-9ff1-898cc4f14967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:46.212970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c6df6fb1-dc83-4cce-9ff1-898cc4f14967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:46.307076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df6fb1-dc83-4cce-9ff1-898cc4f14967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:46.308831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df6fb1-dc83-4cce-9ff1-898cc4f14967 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:46.328511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 695/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:47.327603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bfa6-a655-4b71-b2a5-2c20e7935093 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:47.328175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bfa6-a655-4b71-b2a5-2c20e7935093 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:47.328175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bfa6-a655-4b71-b2a5-2c20e7935093 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:47.329602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 674/1369] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:47.335094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae1d0-be38-4bf8-a394-5390642d465a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:47.335558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae1d0-be38-4bf8-a394-5390642d465a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:47.335648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae1d0-be38-4bf8-a394-5390642d465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:47.369390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:47.406418 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ff6ae1d0-be38-4bf8-a394-5390642d465a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:47.407656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ff6ae1d0-be38-4bf8-a394-5390642d465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:47.510988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 696/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:47.863939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf30757-bbe7-4321-bd08-01af53021922 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:47.864224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf30757-bbe7-4321-bd08-01af53021922 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:47.864503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf30757-bbe7-4321-bd08-01af53021922 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:47.866253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 675/1371] 10.222.0.46 () {54 vars in 964 bytes} [Tue Jul 26 07:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:47.870809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950043-8bf4-4aa3-baf0-6d5e2f46a207 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:47.871138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950043-8bf4-4aa3-baf0-6d5e2f46a207 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:47.871396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a950043-8bf4-4aa3-baf0-6d5e2f46a207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:47.951585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5a950043-8bf4-4aa3-baf0-6d5e2f46a207 None None] MFA Rules not processed for user `c1886d36711f4ca48191ebfbee3e9a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:47.952791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5a950043-8bf4-4aa3-baf0-6d5e2f46a207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:48.002143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:48.036356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 697/1372] 10.222.0.46 () {58 vars in 1061 bytes} [Tue Jul 26 07:44:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:48.044244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf30757-bbe7-4321-bd08-01af53021922 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:48.045746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-fcf30757-bbe7-4321-bd08-01af53021922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:48.099432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:48.160147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf30757-bbe7-4321-bd08-01af53021922 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:48.238014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf65881-3355-4b4a-9846-35e3d64380db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:48.238636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf65881-3355-4b4a-9846-35e3d64380db service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:48.238914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf65881-3355-4b4a-9846-35e3d64380db service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:48.239211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf65881-3355-4b4a-9846-35e3d64380db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:48.240983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4cf65881-3355-4b4a-9846-35e3d64380db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:48.350592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:48.366104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf65881-3355-4b4a-9846-35e3d64380db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:48.367602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf65881-3355-4b4a-9846-35e3d64380db service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:48.387508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 676/1373] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:48.405470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf94f0-2e9f-4f47-8de0-5db780a67f29 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:48.406062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf94f0-2e9f-4f47-8de0-5db780a67f29 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:48.406062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf94f0-2e9f-4f47-8de0-5db780a67f29 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:48.407706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 698/1374] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:44:48.413214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b8a9-1c51-4284-81c4-0635c192df05 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:48.413526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b8a9-1c51-4284-81c4-0635c192df05 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:48.413847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b8a9-1c51-4284-81c4-0635c192df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:48.487288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b600b8a9-1c51-4284-81c4-0635c192df05 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:48.489578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b600b8a9-1c51-4284-81c4-0635c192df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:48.603437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 677/1375] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:48.649334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf94f0-2e9f-4f47-8de0-5db780a67f29 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:48.651336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f4bf94f0-2e9f-4f47-8de0-5db780a67f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:48.820631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf94f0-2e9f-4f47-8de0-5db780a67f29 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:48.879387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:48.942986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de30a2-ef7b-4eed-a03e-c793af4e7ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:48.943613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de30a2-ef7b-4eed-a03e-c793af4e7ffd service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:48.943896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de30a2-ef7b-4eed-a03e-c793af4e7ffd service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:48.944171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de30a2-ef7b-4eed-a03e-c793af4e7ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:48.945811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-90de30a2-ef7b-4eed-a03e-c793af4e7ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:49.038365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de30a2-ef7b-4eed-a03e-c793af4e7ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:49.040019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de30a2-ef7b-4eed-a03e-c793af4e7ffd service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:49.059880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 699/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:51.066977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6cc8-6279-4129-bbde-de820a0e9c6c None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:51.067472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6cc8-6279-4129-bbde-de820a0e9c6c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:51.067472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6cc8-6279-4129-bbde-de820a0e9c6c None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:51.068806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 678/1377] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:51.073911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53ca4-1269-4463-adcf-f5d42c1802d3 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:51.074321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53ca4-1269-4463-adcf-f5d42c1802d3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:51.074576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53ca4-1269-4463-adcf-f5d42c1802d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:51.139643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-55b53ca4-1269-4463-adcf-f5d42c1802d3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:51.140781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-55b53ca4-1269-4463-adcf-f5d42c1802d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:51.147808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:51.244660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 700/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:51.288907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d6cc8-6279-4129-bbde-de820a0e9c6c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:51.290574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4f4d6cc8-6279-4129-bbde-de820a0e9c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:51.364177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:51.460596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d6cc8-6279-4129-bbde-de820a0e9c6c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:51.577782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eda5f-6d73-43f1-8573-76da33ca3ca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:51.578407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eda5f-6d73-43f1-8573-76da33ca3ca2 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:51.578692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eda5f-6d73-43f1-8573-76da33ca3ca2 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:51.579001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eda5f-6d73-43f1-8573-76da33ca3ca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:51.580743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7e4eda5f-6d73-43f1-8573-76da33ca3ca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:51.600242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:51.672340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eda5f-6d73-43f1-8573-76da33ca3ca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:51.673965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eda5f-6d73-43f1-8573-76da33ca3ca2 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:51.692638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 679/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:53.739337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff580c84-aa8a-4bc5-9e3b-55f05e0d6d4d None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:53.739870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff580c84-aa8a-4bc5-9e3b-55f05e0d6d4d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:53.739953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff580c84-aa8a-4bc5-9e3b-55f05e0d6d4d None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:53.741407 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 701/1380] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:53.746472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7781e3-2671-4846-b411-74c3633e4ce2 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:53.746866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7781e3-2671-4846-b411-74c3633e4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:53.747153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7781e3-2671-4846-b411-74c3633e4ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:53.817385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-6a7781e3-2671-4846-b411-74c3633e4ce2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:53.818506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6a7781e3-2671-4846-b411-74c3633e4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:53.936723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:53.946962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 680/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:53.989590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff580c84-aa8a-4bc5-9e3b-55f05e0d6d4d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:53.991140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ff580c84-aa8a-4bc5-9e3b-55f05e0d6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:54.135888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:54.147711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff580c84-aa8a-4bc5-9e3b-55f05e0d6d4d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:54.273551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b07a-81df-483c-b974-f0c474cd8516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:54.274268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b07a-81df-483c-b974-f0c474cd8516 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:54.274618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b07a-81df-483c-b974-f0c474cd8516 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:54.274982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b07a-81df-483c-b974-f0c474cd8516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:54.276950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1ce9b07a-81df-483c-b974-f0c474cd8516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:54.372533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9b07a-81df-483c-b974-f0c474cd8516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:54.374587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9b07a-81df-483c-b974-f0c474cd8516 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:54.385577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:54.401780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 702/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:56.440942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6a251-7c5d-482a-af93-38afc5e1ef69 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:56.441658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6a251-7c5d-482a-af93-38afc5e1ef69 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:56.441658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6a251-7c5d-482a-af93-38afc5e1ef69 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:56.442863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 681/1383] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:56.449635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23998f-cb62-4451-91d1-f8a2029f9c55 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:56.450050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23998f-cb62-4451-91d1-f8a2029f9c55 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:56.450396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23998f-cb62-4451-91d1-f8a2029f9c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:56.525369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-1d23998f-cb62-4451-91d1-f8a2029f9c55 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:56.526636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1d23998f-cb62-4451-91d1-f8a2029f9c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:56.633812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 703/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:56.686078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6a251-7c5d-482a-af93-38afc5e1ef69 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:56.687664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-33e6a251-7c5d-482a-af93-38afc5e1ef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:56.855422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6a251-7c5d-482a-af93-38afc5e1ef69 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:56.926122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:56.981469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c47e3b-8e0e-4fea-9c48-12372f5a464f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:56.982232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c47e3b-8e0e-4fea-9c48-12372f5a464f service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:56.982586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c47e3b-8e0e-4fea-9c48-12372f5a464f service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:56.983045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c47e3b-8e0e-4fea-9c48-12372f5a464f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:56.985182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-47c47e3b-8e0e-4fea-9c48-12372f5a464f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:57.089926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c47e3b-8e0e-4fea-9c48-12372f5a464f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:57.091654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c47e3b-8e0e-4fea-9c48-12372f5a464f service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:57.110717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 682/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:44:59.107557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef202c-4cba-496f-8979-67275ba02c95 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:59.108155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef202c-4cba-496f-8979-67275ba02c95 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:59.108155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef202c-4cba-496f-8979-67275ba02c95 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:59.109466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 704/1386] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:44:59.115602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd63d9-e93d-4a47-b8df-877962a5f60f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:59.116058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd63d9-e93d-4a47-b8df-877962a5f60f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:59.116220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd63d9-e93d-4a47-b8df-877962a5f60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:59.187681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-86bd63d9-e93d-4a47-b8df-877962a5f60f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:44:59.188952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-86bd63d9-e93d-4a47-b8df-877962a5f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:59.226657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:59.300500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 683/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:44:59.345505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef202c-4cba-496f-8979-67275ba02c95 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:44:59.348203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-38ef202c-4cba-496f-8979-67275ba02c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:59.444413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:59.524195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef202c-4cba-496f-8979-67275ba02c95 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:44:59.641328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef11df-2889-49ab-8ef4-ebcbb60d74bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:44:59.641944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef11df-2889-49ab-8ef4-ebcbb60d74bb service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:44:59.642295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef11df-2889-49ab-8ef4-ebcbb60d74bb service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:44:59.642521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef11df-2889-49ab-8ef4-ebcbb60d74bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:44:59.645038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-afef11df-2889-49ab-8ef4-ebcbb60d74bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:44:59.684620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:44:59.745244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef11df-2889-49ab-8ef4-ebcbb60d74bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:44:59.746835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef11df-2889-49ab-8ef4-ebcbb60d74bb service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:44:59.766033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 705/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:01.785452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab23eb-9f1f-42ca-ad87-3c36b058fbbe None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:01.786016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab23eb-9f1f-42ca-ad87-3c36b058fbbe None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:01.786016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab23eb-9f1f-42ca-ad87-3c36b058fbbe None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:01.787366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 684/1389] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:01.792563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098bee-45e0-4394-849b-e350468406f3 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:01.792994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098bee-45e0-4394-849b-e350468406f3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:01.793127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098bee-45e0-4394-849b-e350468406f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:01.861643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a2098bee-45e0-4394-849b-e350468406f3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:01.862899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a2098bee-45e0-4394-849b-e350468406f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:01.961342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 706/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:02.006179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab23eb-9f1f-42ca-ad87-3c36b058fbbe None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:02.007758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-69ab23eb-9f1f-42ca-ad87-3c36b058fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:02.153460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab23eb-9f1f-42ca-ad87-3c36b058fbbe None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:02.169969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:02.267486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73498c-dd55-4c36-ba86-0e7789532c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:02.268289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73498c-dd55-4c36-ba86-0e7789532c6e service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:02.268836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73498c-dd55-4c36-ba86-0e7789532c6e service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:02.269718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73498c-dd55-4c36-ba86-0e7789532c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:02.271389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4d73498c-dd55-4c36-ba86-0e7789532c6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:02.359315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73498c-dd55-4c36-ba86-0e7789532c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:02.360929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73498c-dd55-4c36-ba86-0e7789532c6e service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:02.379265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 685/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:03.383877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d6a8-77b9-4f51-98b4-3c97572bb8e7 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:03.384458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d6a8-77b9-4f51-98b4-3c97572bb8e7 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:03.384458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d6a8-77b9-4f51-98b4-3c97572bb8e7 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:03.385926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 707/1392] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:03.390887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e529e-fde9-4550-b618-523c20e73168 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:03.391316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e529e-fde9-4550-b618-523c20e73168 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:03.391467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e529e-fde9-4550-b618-523c20e73168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:03.418118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:03.460408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d01e529e-fde9-4550-b618-523c20e73168 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:03.461632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d01e529e-fde9-4550-b618-523c20e73168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:03.562491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 686/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:03.620112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070548-bf77-4a66-ae55-960701c19e2c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:03.620402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070548-bf77-4a66-ae55-960701c19e2c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:03.620681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070548-bf77-4a66-ae55-960701c19e2c None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:03.622026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 708/1394] 10.222.0.46 () {54 vars in 966 bytes} [Tue Jul 26 07:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:03.627025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657b05-7f03-4177-8c72-75333fc3a187 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:03.627273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657b05-7f03-4177-8c72-75333fc3a187 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:03.627583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657b05-7f03-4177-8c72-75333fc3a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:03.703128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-57657b05-7f03-4177-8c72-75333fc3a187 None None] MFA Rules not processed for user `bde6248cf0794fab88a093097b597c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:03.704321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-57657b05-7f03-4177-8c72-75333fc3a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:03.744409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:03.781439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 687/1395] 10.222.0.46 () {58 vars in 1063 bytes} [Tue Jul 26 07:45:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:03.788850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7070548-bf77-4a66-ae55-960701c19e2c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:03.790483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e7070548-bf77-4a66-ae55-960701c19e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:03.804491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:03.898042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7070548-bf77-4a66-ae55-960701c19e2c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:03.970511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022411a-5dba-45b7-8131-08cf7e98ef87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde6248cf0794fab88a093097b597c9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:03.971071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022411a-5dba-45b7-8131-08cf7e98ef87 service glance] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:03.971354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022411a-5dba-45b7-8131-08cf7e98ef87 service glance] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:03.971629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022411a-5dba-45b7-8131-08cf7e98ef87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:03.973322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e022411a-5dba-45b7-8131-08cf7e98ef87 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:04.042846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:04.084868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022411a-5dba-45b7-8131-08cf7e98ef87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:04.086374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022411a-5dba-45b7-8131-08cf7e98ef87 service glance] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:04.104408 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 709/1396] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:04.405441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865f2e-edd6-4337-9b0b-2ad1204c20e4 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:04.406360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865f2e-edd6-4337-9b0b-2ad1204c20e4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:04.406360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865f2e-edd6-4337-9b0b-2ad1204c20e4 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:04.407867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 688/1397] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:04.415883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ce4e-178e-4601-9c71-5c948257cfec None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:04.416410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ce4e-178e-4601-9c71-5c948257cfec None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:04.416797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ce4e-178e-4601-9c71-5c948257cfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:04.491179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c7c5ce4e-178e-4601-9c71-5c948257cfec None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:04.492653 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c7c5ce4e-178e-4601-9c71-5c948257cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:04.591680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 710/1398] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:04.636181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865f2e-edd6-4337-9b0b-2ad1204c20e4 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:04.637697 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-45865f2e-edd6-4337-9b0b-2ad1204c20e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:04.798143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865f2e-edd6-4337-9b0b-2ad1204c20e4 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:04.845764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c01f58-23a8-4a7a-9343-d0ca21b970fe None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:04.845764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c01f58-23a8-4a7a-9343-d0ca21b970fe None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:04.845764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c01f58-23a8-4a7a-9343-d0ca21b970fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:04.851622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:04.870636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:04.913084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f3c01f58-23a8-4a7a-9343-d0ca21b970fe None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:04.914295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f3c01f58-23a8-4a7a-9343-d0ca21b970fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:04.918669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686114b-a832-44d4-972d-65bd5720f6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:04.919320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686114b-a832-44d4-972d-65bd5720f6e9 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:04.919619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686114b-a832-44d4-972d-65bd5720f6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:04.919873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686114b-a832-44d4-972d-65bd5720f6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:04.921471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c686114b-a832-44d4-972d-65bd5720f6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:05.000716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 711/1399] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:45:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:45:05.013839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686114b-a832-44d4-972d-65bd5720f6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:05.015645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686114b-a832-44d4-972d-65bd5720f6e9 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:05.040368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 689/1400] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:05.048898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45ffd6-4aae-44f6-ab2d-59aeb776533e None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:05.049218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45ffd6-4aae-44f6-ab2d-59aeb776533e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:05.049493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45ffd6-4aae-44f6-ab2d-59aeb776533e None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:05.050882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 712/1401] 10.222.0.46 () {54 vars in 943 bytes} [Tue Jul 26 07:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:05.058024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36fb1-3a58-4354-9d80-1cffae17fdb6 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:05.058315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36fb1-3a58-4354-9d80-1cffae17fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:05.058592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36fb1-3a58-4354-9d80-1cffae17fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:05.124003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:05.141701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ecf36fb1-3a58-4354-9d80-1cffae17fdb6 None None] MFA Rules not processed for user `de1dd35abd2e4db0bda795191eeee287`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:05.142976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ecf36fb1-3a58-4354-9d80-1cffae17fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:05.259293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 690/1402] 10.222.0.46 () {58 vars in 1040 bytes} [Tue Jul 26 07:45:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:05.269580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45ffd6-4aae-44f6-ab2d-59aeb776533e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:05.271125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2a45ffd6-4aae-44f6-ab2d-59aeb776533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:05.377302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:05.410685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45ffd6-4aae-44f6-ab2d-59aeb776533e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:05.515579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d924a2-9572-4ee2-95f6-e25506f15b18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:05.516257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d924a2-9572-4ee2-95f6-e25506f15b18 service swift] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:05.516499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d924a2-9572-4ee2-95f6-e25506f15b18 service swift] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:05.516773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d924a2-9572-4ee2-95f6-e25506f15b18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:05.518701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e2d924a2-9572-4ee2-95f6-e25506f15b18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:05.601822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d924a2-9572-4ee2-95f6-e25506f15b18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:05.603467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d924a2-9572-4ee2-95f6-e25506f15b18 service swift] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:05.611552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 713/1403] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:45:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:45:07.092389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da10ba-f21a-4fde-8e15-80d5407f0f8e None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:07.092963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da10ba-f21a-4fde-8e15-80d5407f0f8e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:07.092963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da10ba-f21a-4fde-8e15-80d5407f0f8e None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:07.094462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 691/1404] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:07.100341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ee6-8a11-4faf-be6a-ec146ba1da49 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:07.100770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ee6-8a11-4faf-be6a-ec146ba1da49 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:07.100900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ee6-8a11-4faf-be6a-ec146ba1da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:07.116226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:07.177976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f3d26ee6-8a11-4faf-be6a-ec146ba1da49 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:07.179476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f3d26ee6-8a11-4faf-be6a-ec146ba1da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:07.316339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 714/1405] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:07.362027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da10ba-f21a-4fde-8e15-80d5407f0f8e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:07.363802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-99da10ba-f21a-4fde-8e15-80d5407f0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:07.482522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:07.533442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da10ba-f21a-4fde-8e15-80d5407f0f8e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:07.660554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3697d3-2f7e-4b67-8292-fc31ac3efe25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:07.661180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3697d3-2f7e-4b67-8292-fc31ac3efe25 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:07.661461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3697d3-2f7e-4b67-8292-fc31ac3efe25 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:07.661728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3697d3-2f7e-4b67-8292-fc31ac3efe25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:07.663422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8f3697d3-2f7e-4b67-8292-fc31ac3efe25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:07.751076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:07.772265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3697d3-2f7e-4b67-8292-fc31ac3efe25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:07.774052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3697d3-2f7e-4b67-8292-fc31ac3efe25 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:07.796373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 692/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:09.888112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd8115-1fbd-430f-bd81-fbee18510e0b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:09.888682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd8115-1fbd-430f-bd81-fbee18510e0b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:09.888682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd8115-1fbd-430f-bd81-fbee18510e0b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:09.890031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 715/1407] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:09.895560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15cb03-470e-4b05-a2a8-198ac51c19cb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:09.895984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15cb03-470e-4b05-a2a8-198ac51c19cb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:09.896129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15cb03-470e-4b05-a2a8-198ac51c19cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:09.967869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3c15cb03-470e-4b05-a2a8-198ac51c19cb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:09.969107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3c15cb03-470e-4b05-a2a8-198ac51c19cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:10.094958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 693/1408] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:10.137826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd8115-1fbd-430f-bd81-fbee18510e0b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:10.139464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f9cd8115-1fbd-430f-bd81-fbee18510e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:10.235013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:10.300189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd8115-1fbd-430f-bd81-fbee18510e0b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:10.423224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98572d-dd38-4ff9-b2a4-82d0dccd68ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:10.423883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98572d-dd38-4ff9-b2a4-82d0dccd68ed service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:10.424161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98572d-dd38-4ff9-b2a4-82d0dccd68ed service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:10.424440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98572d-dd38-4ff9-b2a4-82d0dccd68ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:10.426163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7d98572d-dd38-4ff9-b2a4-82d0dccd68ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:10.487740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:10.528702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98572d-dd38-4ff9-b2a4-82d0dccd68ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:10.530412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98572d-dd38-4ff9-b2a4-82d0dccd68ed service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:10.551170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 716/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:20.091166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=78 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:20.546681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=22 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:27.684929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9403c1-eb7b-436e-8c11-d70ff08cc55f None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:27.685503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9403c1-eb7b-436e-8c11-d70ff08cc55f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:27.685503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9403c1-eb7b-436e-8c11-d70ff08cc55f None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:27.686825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 694/1410] 10.222.0.46 () {54 vars in 918 bytes} [Tue Jul 26 07:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:27.692355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eb16d-1238-45c2-9a27-90a0afa6767d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:27.692779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eb16d-1238-45c2-9a27-90a0afa6767d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:27.692915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eb16d-1238-45c2-9a27-90a0afa6767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:27.767581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4f7eb16d-1238-45c2-9a27-90a0afa6767d None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:27.769628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4f7eb16d-1238-45c2-9a27-90a0afa6767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:27.876704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 717/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jul 26 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:27.891411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96757b12-7e9b-436b-965e-96a328714ad8 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:27.891696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96757b12-7e9b-436b-965e-96a328714ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:27.891970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96757b12-7e9b-436b-965e-96a328714ad8 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:27.894196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 695/1412] 10.222.0.46 () {54 vars in 918 bytes} [Tue Jul 26 07:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:45:27.898693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068781dd-0d85-4fc6-97c3-c6102eb2aab0 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:27.899019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068781dd-0d85-4fc6-97c3-c6102eb2aab0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:27.899303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068781dd-0d85-4fc6-97c3-c6102eb2aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:27.970568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:27.973287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-068781dd-0d85-4fc6-97c3-c6102eb2aab0 None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:27.975082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-068781dd-0d85-4fc6-97c3-c6102eb2aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:28.089889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 718/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jul 26 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:30.523146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78414fdd-4589-4474-9a30-06003b86b1b3 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:30.523714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78414fdd-4589-4474-9a30-06003b86b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:30.523714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78414fdd-4589-4474-9a30-06003b86b1b3 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:30.525094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:30.530179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3845-92cb-4b1b-8a76-407fa21ccdb6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:30.530574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3845-92cb-4b1b-8a76-407fa21ccdb6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:30.530741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3845-92cb-4b1b-8a76-407fa21ccdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:30.597018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a9ef3845-92cb-4b1b-8a76-407fa21ccdb6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:30.598160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a9ef3845-92cb-4b1b-8a76-407fa21ccdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:30.653453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:30.694842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:30.736535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78414fdd-4589-4474-9a30-06003b86b1b3 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:30.738040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-78414fdd-4589-4474-9a30-06003b86b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:30.881871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78414fdd-4589-4474-9a30-06003b86b1b3 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:30.953390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:30.992787 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894e0cb-a210-4857-970d-874715aefbda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:30.993405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894e0cb-a210-4857-970d-874715aefbda service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:30.993679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894e0cb-a210-4857-970d-874715aefbda service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:30.993955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894e0cb-a210-4857-970d-874715aefbda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:30.995592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6894e0cb-a210-4857-970d-874715aefbda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:31.081737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894e0cb-a210-4857-970d-874715aefbda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:31.083356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894e0cb-a210-4857-970d-874715aefbda service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:31.100939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 697/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:31.995400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c3cf4-4e38-402a-a27f-b51cfb680876 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:31.995948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c3cf4-4e38-402a-a27f-b51cfb680876 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:31.995948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c3cf4-4e38-402a-a27f-b51cfb680876 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:31.997322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:32.002096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2644d0-3aac-430e-bfd5-f9a434cabbbb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:32.002539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2644d0-3aac-430e-bfd5-f9a434cabbbb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:32.002656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2644d0-3aac-430e-bfd5-f9a434cabbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:32.077993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1f2644d0-3aac-430e-bfd5-f9a434cabbbb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:32.079233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1f2644d0-3aac-430e-bfd5-f9a434cabbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:32.106213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:32.175852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:32.325423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c3cf4-4e38-402a-a27f-b51cfb680876 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:32.326953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-431c3cf4-4e38-402a-a27f-b51cfb680876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:32.471110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c3cf4-4e38-402a-a27f-b51cfb680876 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:32.511379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:32.584850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea472c-f544-49ed-b50c-7b083fd1b2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:32.585472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea472c-f544-49ed-b50c-7b083fd1b2e4 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:32.585753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea472c-f544-49ed-b50c-7b083fd1b2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:32.586027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea472c-f544-49ed-b50c-7b083fd1b2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:32.587744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-41ea472c-f544-49ed-b50c-7b083fd1b2e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:32.678244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea472c-f544-49ed-b50c-7b083fd1b2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:32.679880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea472c-f544-49ed-b50c-7b083fd1b2e4 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:32.698136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 721/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:33.564209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985e8f-6d82-4c82-bc08-1ee3af19535f None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:33.564771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985e8f-6d82-4c82-bc08-1ee3af19535f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:33.564771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985e8f-6d82-4c82-bc08-1ee3af19535f None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:33.566162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:33.571107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737a659-329e-4349-9081-0371f0ef095d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:33.571540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737a659-329e-4349-9081-0371f0ef095d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:33.571668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737a659-329e-4349-9081-0371f0ef095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:33.625842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:33.648747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-e737a659-329e-4349-9081-0371f0ef095d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:33.649975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e737a659-329e-4349-9081-0371f0ef095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:33.748292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:33.899062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24985e8f-6d82-4c82-bc08-1ee3af19535f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:33.900591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-24985e8f-6d82-4c82-bc08-1ee3af19535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:34.048112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24985e8f-6d82-4c82-bc08-1ee3af19535f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:34.060154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:34.160943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed2d40-386b-4f98-8c46-126f88449daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:34.161565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2d40-386b-4f98-8c46-126f88449daa service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:34.161845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2d40-386b-4f98-8c46-126f88449daa service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:34.162116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2d40-386b-4f98-8c46-126f88449daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:34.164275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b6ed2d40-386b-4f98-8c46-126f88449daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:34.251914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed2d40-386b-4f98-8c46-126f88449daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:34.253568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed2d40-386b-4f98-8c46-126f88449daa service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:34.272033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 700/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:35.132411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519080b-a5fa-4b12-8d15-a1119a71fb5c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:35.132919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519080b-a5fa-4b12-8d15-a1119a71fb5c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:35.132919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519080b-a5fa-4b12-8d15-a1119a71fb5c None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:35.134379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:35.139307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b01f2-5e83-4467-be37-d98229b0b196 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:35.139690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b01f2-5e83-4467-be37-d98229b0b196 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:35.139868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b01f2-5e83-4467-be37-d98229b0b196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:35.160004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:35.216135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-268b01f2-5e83-4467-be37-d98229b0b196 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:35.217352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-268b01f2-5e83-4467-be37-d98229b0b196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:35.315233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:35.464473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519080b-a5fa-4b12-8d15-a1119a71fb5c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:35.466006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b519080b-a5fa-4b12-8d15-a1119a71fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:35.575149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:35.612412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519080b-a5fa-4b12-8d15-a1119a71fb5c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:35.725503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7dc99-683a-4ab0-8040-b36ff9f14229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:35.726045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7dc99-683a-4ab0-8040-b36ff9f14229 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:35.726327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7dc99-683a-4ab0-8040-b36ff9f14229 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:35.726602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7dc99-683a-4ab0-8040-b36ff9f14229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:35.728262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-31e7dc99-683a-4ab0-8040-b36ff9f14229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:35.804568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:35.818592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7dc99-683a-4ab0-8040-b36ff9f14229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:35.820227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7dc99-683a-4ab0-8040-b36ff9f14229 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:35.838643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 724/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:36.697430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771296db-3ff9-4df8-af90-fac16fbcd64e None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:36.697990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771296db-3ff9-4df8-af90-fac16fbcd64e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:36.697990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771296db-3ff9-4df8-af90-fac16fbcd64e None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:36.699390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:36.704334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803ab1-39d7-4885-8829-4236188f7c40 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:36.704773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803ab1-39d7-4885-8829-4236188f7c40 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:36.704884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803ab1-39d7-4885-8829-4236188f7c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:36.899526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f7803ab1-39d7-4885-8829-4236188f7c40 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:36.900736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f7803ab1-39d7-4885-8829-4236188f7c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:36.995312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:37.144227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771296db-3ff9-4df8-af90-fac16fbcd64e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:37.145797 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-771296db-3ff9-4df8-af90-fac16fbcd64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:37.228378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:37.290847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771296db-3ff9-4df8-af90-fac16fbcd64e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:37.400266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5751fd-d335-45a1-a1c8-35d73472b9ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:37.400875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5751fd-d335-45a1-a1c8-35d73472b9ae service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:37.401153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5751fd-d335-45a1-a1c8-35d73472b9ae service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:37.401421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5751fd-d335-45a1-a1c8-35d73472b9ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:37.403053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4e5751fd-d335-45a1-a1c8-35d73472b9ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:37.448945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:37.490427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5751fd-d335-45a1-a1c8-35d73472b9ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:37.492069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5751fd-d335-45a1-a1c8-35d73472b9ae service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:37.510284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 703/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:38.300403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dba519-5e20-4e8a-9ce0-4b067a723f93 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:38.300969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dba519-5e20-4e8a-9ce0-4b067a723f93 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:38.300969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dba519-5e20-4e8a-9ce0-4b067a723f93 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:38.302299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:38.307297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afa67-63ef-431d-b354-30d4dfc4b3cc None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:38.307761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afa67-63ef-431d-b354-30d4dfc4b3cc None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:38.307860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afa67-63ef-431d-b354-30d4dfc4b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:38.383177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-158afa67-63ef-431d-b354-30d4dfc4b3cc None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:38.384392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-158afa67-63ef-431d-b354-30d4dfc4b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:38.480068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:45:38.631981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dba519-5e20-4e8a-9ce0-4b067a723f93 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:38.633607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d6dba519-5e20-4e8a-9ce0-4b067a723f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:38.682361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:38.778037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dba519-5e20-4e8a-9ce0-4b067a723f93 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:38.890055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4d77b-3ed8-4771-842c-a1057bbe6547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:38.890614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d77b-3ed8-4771-842c-a1057bbe6547 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:38.890898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d77b-3ed8-4771-842c-a1057bbe6547 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:38.891204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d77b-3ed8-4771-842c-a1057bbe6547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:38.893107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-53c4d77b-3ed8-4771-842c-a1057bbe6547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:38.900018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:38.982252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4d77b-3ed8-4771-842c-a1057bbe6547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:38.983883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4d77b-3ed8-4771-842c-a1057bbe6547 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:39.001962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 727/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:39.793017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98013f-1f18-4a9e-a684-c3825f1c2087 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:39.793620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98013f-1f18-4a9e-a684-c3825f1c2087 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:39.793620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98013f-1f18-4a9e-a684-c3825f1c2087 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:39.794999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:39.799914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e26b-ba36-44df-b83b-58797c8b250f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:39.800310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e26b-ba36-44df-b83b-58797c8b250f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:39.800464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e26b-ba36-44df-b83b-58797c8b250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:39.875478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a7d7e26b-ba36-44df-b83b-58797c8b250f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:39.876685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a7d7e26b-ba36-44df-b83b-58797c8b250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:39.944351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:39.972935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:40.121922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98013f-1f18-4a9e-a684-c3825f1c2087 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:40.123403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-db98013f-1f18-4a9e-a684-c3825f1c2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:40.141200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:40.269796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98013f-1f18-4a9e-a684-c3825f1c2087 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:40.477094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:40.503936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b590313-9088-4009-a492-20f240f064c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:40.504548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b590313-9088-4009-a492-20f240f064c9 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:40.504825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b590313-9088-4009-a492-20f240f064c9 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:40.505098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b590313-9088-4009-a492-20f240f064c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:40.506711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1b590313-9088-4009-a492-20f240f064c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:40.592833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b590313-9088-4009-a492-20f240f064c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:40.594394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b590313-9088-4009-a492-20f240f064c9 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:40.612901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 706/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:41.419835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4184be-cbea-4d5d-b6a4-9d76f308c988 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:41.420421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4184be-cbea-4d5d-b6a4-9d76f308c988 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:41.420421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4184be-cbea-4d5d-b6a4-9d76f308c988 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:41.421740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:41.427120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d90e7-ed80-4ef6-b910-0486c331e922 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:41.427508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d90e7-ed80-4ef6-b910-0486c331e922 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:41.427671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d90e7-ed80-4ef6-b910-0486c331e922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:41.502731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1f6d90e7-ed80-4ef6-b910-0486c331e922 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:41.504012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1f6d90e7-ed80-4ef6-b910-0486c331e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:41.544816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:41.599334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:41.748173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4184be-cbea-4d5d-b6a4-9d76f308c988 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:41.749617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0f4184be-cbea-4d5d-b6a4-9d76f308c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:41.893462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4184be-cbea-4d5d-b6a4-9d76f308c988 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:41.946441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:42.004447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06298080-358b-4d1d-9f93-80f2a9cf308f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:42.004999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298080-358b-4d1d-9f93-80f2a9cf308f service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:42.005280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298080-358b-4d1d-9f93-80f2a9cf308f service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:42.005553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298080-358b-4d1d-9f93-80f2a9cf308f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:42.007214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-06298080-358b-4d1d-9f93-80f2a9cf308f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:42.095107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06298080-358b-4d1d-9f93-80f2a9cf308f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:42.097191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06298080-358b-4d1d-9f93-80f2a9cf308f service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:42.115105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 730/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:42.912762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7ca7-3428-414e-9c3e-363979bf69e9 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:42.913345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7ca7-3428-414e-9c3e-363979bf69e9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:42.913345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7ca7-3428-414e-9c3e-363979bf69e9 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:42.914696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:42.919682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48f42b-395f-4224-a026-6fbf9d55ac96 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:42.920103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48f42b-395f-4224-a026-6fbf9d55ac96 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:42.920238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48f42b-395f-4224-a026-6fbf9d55ac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:42.995158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-bd48f42b-395f-4224-a026-6fbf9d55ac96 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:42.996361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bd48f42b-395f-4224-a026-6fbf9d55ac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:42.998352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:43.091604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:43.239800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7ca7-3428-414e-9c3e-363979bf69e9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:43.241346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-243d7ca7-3428-414e-9c3e-363979bf69e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:43.386860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7ca7-3428-414e-9c3e-363979bf69e9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:43.413478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:43.498522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e468b-6a12-4528-8997-3acd08102521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:43.499172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e468b-6a12-4528-8997-3acd08102521 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:43.499454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e468b-6a12-4528-8997-3acd08102521 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:43.499726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e468b-6a12-4528-8997-3acd08102521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:43.501341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4e0e468b-6a12-4528-8997-3acd08102521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:43.589220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e468b-6a12-4528-8997-3acd08102521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:43.590803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e468b-6a12-4528-8997-3acd08102521 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:43.608441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 709/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:45.493751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30baf9-3ea3-4787-a85a-bd3331c41198 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:45.494310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30baf9-3ea3-4787-a85a-bd3331c41198 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:45.494310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30baf9-3ea3-4787-a85a-bd3331c41198 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:45.495731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:45.500869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f03e-de18-4e84-a620-03acf26e22ac None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:45.501281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f03e-de18-4e84-a620-03acf26e22ac None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:45.501407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f03e-de18-4e84-a620-03acf26e22ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:45.543005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:45.568699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d790f03e-de18-4e84-a620-03acf26e22ac None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:45.569925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d790f03e-de18-4e84-a620-03acf26e22ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:45.671423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:45.709916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30baf9-3ea3-4787-a85a-bd3331c41198 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:45.711543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3f30baf9-3ea3-4787-a85a-bd3331c41198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:45.816907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30baf9-3ea3-4787-a85a-bd3331c41198 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:45.849478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:45.890824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506be30-3b91-486d-a7b0-847f6bcd5bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:45.891469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506be30-3b91-486d-a7b0-847f6bcd5bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:45.891747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506be30-3b91-486d-a7b0-847f6bcd5bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:45.892019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506be30-3b91-486d-a7b0-847f6bcd5bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:45.893926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c506be30-3b91-486d-a7b0-847f6bcd5bf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:46.001756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506be30-3b91-486d-a7b0-847f6bcd5bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:46.003212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506be30-3b91-486d-a7b0-847f6bcd5bf2 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:46.021556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 733/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:48.155363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71905959-d06d-4af0-a923-2cf50f563cac None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:48.155940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71905959-d06d-4af0-a923-2cf50f563cac None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:48.155940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71905959-d06d-4af0-a923-2cf50f563cac None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:48.157269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:48.162425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9e4a-8a21-40b1-907f-179d94bf83c8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:48.162852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9e4a-8a21-40b1-907f-179d94bf83c8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:48.163012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9e4a-8a21-40b1-907f-179d94bf83c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:48.227431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-513c9e4a-8a21-40b1-907f-179d94bf83c8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:48.228636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-513c9e4a-8a21-40b1-907f-179d94bf83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:48.242965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:48.327785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:48.365891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71905959-d06d-4af0-a923-2cf50f563cac None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:48.367463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-71905959-d06d-4af0-a923-2cf50f563cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:48.467651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71905959-d06d-4af0-a923-2cf50f563cac None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:48.479375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:48.542959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a49e13-48b4-4f29-aa25-6fd8a822f7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:48.543583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a49e13-48b4-4f29-aa25-6fd8a822f7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:48.543860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a49e13-48b4-4f29-aa25-6fd8a822f7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:48.544129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a49e13-48b4-4f29-aa25-6fd8a822f7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:48.545736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c1a49e13-48b4-4f29-aa25-6fd8a822f7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:48.651492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a49e13-48b4-4f29-aa25-6fd8a822f7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:48.652913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a49e13-48b4-4f29-aa25-6fd8a822f7f9 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:48.670713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 712/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:50.963097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadcf84-2b0d-4922-9b66-8be81ca6d531 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:50.963658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadcf84-2b0d-4922-9b66-8be81ca6d531 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:50.963658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadcf84-2b0d-4922-9b66-8be81ca6d531 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:50.965000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:50.970305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea34880-41bb-488f-881b-fab096780464 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:50.970701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea34880-41bb-488f-881b-fab096780464 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:50.970853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea34880-41bb-488f-881b-fab096780464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:51.018409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:51.035660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-bea34880-41bb-488f-881b-fab096780464 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:51.036868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-bea34880-41bb-488f-881b-fab096780464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:51.132698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:51.171451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadcf84-2b0d-4922-9b66-8be81ca6d531 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:51.173072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ecadcf84-2b0d-4922-9b66-8be81ca6d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:51.274984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadcf84-2b0d-4922-9b66-8be81ca6d531 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:51.314672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:51.347560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a2225-25ee-4dc5-a76b-1c159eb87852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:51.348175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a2225-25ee-4dc5-a76b-1c159eb87852 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:51.348466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a2225-25ee-4dc5-a76b-1c159eb87852 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:51.348720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a2225-25ee-4dc5-a76b-1c159eb87852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:51.350332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1d3a2225-25ee-4dc5-a76b-1c159eb87852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:51.456898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a2225-25ee-4dc5-a76b-1c159eb87852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:51.458331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a2225-25ee-4dc5-a76b-1c159eb87852 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:51.475766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 736/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:45:53.580830 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21e696-4599-4a41-974b-1dc36f997afd None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:53.581406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21e696-4599-4a41-974b-1dc36f997afd None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:53.581406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21e696-4599-4a41-974b-1dc36f997afd None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:53.582747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:53.588675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1e76-64c7-4c07-8866-e3e8bf2991a6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:53.589096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1e76-64c7-4c07-8866-e3e8bf2991a6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:53.589236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1e76-64c7-4c07-8866-e3e8bf2991a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:53.654668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ac6a1e76-64c7-4c07-8866-e3e8bf2991a6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:53.655913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ac6a1e76-64c7-4c07-8866-e3e8bf2991a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:53.676437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:53.752333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:53.790903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21e696-4599-4a41-974b-1dc36f997afd None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:53.792480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0f21e696-4599-4a41-974b-1dc36f997afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:53.897628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21e696-4599-4a41-974b-1dc36f997afd None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:53.917349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:53.969760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf1e36-e0af-4ddd-be38-7f972f163c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:53.970905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1e36-e0af-4ddd-be38-7f972f163c7b service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:53.971218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1e36-e0af-4ddd-be38-7f972f163c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:53.971494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1e36-e0af-4ddd-be38-7f972f163c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:53.973124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a4bf1e36-e0af-4ddd-be38-7f972f163c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:54.080651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf1e36-e0af-4ddd-be38-7f972f163c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:54.082080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf1e36-e0af-4ddd-be38-7f972f163c7b service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:54.100094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 715/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:56.137480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4726-15ce-4385-94d4-688582889b82 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:56.138002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4726-15ce-4385-94d4-688582889b82 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:56.138002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4726-15ce-4385-94d4-688582889b82 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:56.139345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:56.145193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d3e8-0127-4a27-9f35-1b478f3f0827 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:56.145590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d3e8-0127-4a27-9f35-1b478f3f0827 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:56.145748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d3e8-0127-4a27-9f35-1b478f3f0827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:56.207668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:56.210378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-66c8d3e8-0127-4a27-9f35-1b478f3f0827 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:56.212122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-66c8d3e8-0127-4a27-9f35-1b478f3f0827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:56.305531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:56.343166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4726-15ce-4385-94d4-688582889b82 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:56.344680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d0df4726-15ce-4385-94d4-688582889b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:56.446629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4726-15ce-4385-94d4-688582889b82 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:56.493891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:56.518729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f4032-55eb-4e36-ac40-d5532d4d6f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:56.519376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4032-55eb-4e36-ac40-d5532d4d6f14 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:56.519652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4032-55eb-4e36-ac40-d5532d4d6f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:56.519920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4032-55eb-4e36-ac40-d5532d4d6f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:56.521524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cd6f4032-55eb-4e36-ac40-d5532d4d6f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:56.627320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f4032-55eb-4e36-ac40-d5532d4d6f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:56.628742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f4032-55eb-4e36-ac40-d5532d4d6f14 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:56.646538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 739/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:45:58.668469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ccd0-d1d2-4b34-9fcc-cdc057f94a60 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:58.669015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ccd0-d1d2-4b34-9fcc-cdc057f94a60 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:58.669128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ccd0-d1d2-4b34-9fcc-cdc057f94a60 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:58.670485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:45:58.676413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c728-924d-4dc0-92cb-16d095e06232 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:58.676819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c728-924d-4dc0-92cb-16d095e06232 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:58.676969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c728-924d-4dc0-92cb-16d095e06232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:58.741964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ddd2c728-924d-4dc0-92cb-16d095e06232 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:45:58.743197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ddd2c728-924d-4dc0-92cb-16d095e06232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:58.774133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:58.844882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:45:58.883909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877ccd0-d1d2-4b34-9fcc-cdc057f94a60 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:45:58.885442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3877ccd0-d1d2-4b34-9fcc-cdc057f94a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:58.986891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877ccd0-d1d2-4b34-9fcc-cdc057f94a60 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:45:59.014698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:45:59.059626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1d664-7c45-479b-81ad-7d9d2e44da59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:45:59.060244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d664-7c45-479b-81ad-7d9d2e44da59 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:45:59.060525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d664-7c45-479b-81ad-7d9d2e44da59 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:45:59.060802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d664-7c45-479b-81ad-7d9d2e44da59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:45:59.062429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-56a1d664-7c45-479b-81ad-7d9d2e44da59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:45:59.168378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1d664-7c45-479b-81ad-7d9d2e44da59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:45:59.169809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1d664-7c45-479b-81ad-7d9d2e44da59 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:45:59.188177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 718/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:01.279197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd00d5-8c4d-45f4-ae52-b09ab175aed4 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:01.279732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd00d5-8c4d-45f4-ae52-b09ab175aed4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:01.279732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd00d5-8c4d-45f4-ae52-b09ab175aed4 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:01.281100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:01.286783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f8d3d-b04f-4515-b953-a5422d69b0a8 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:01.287209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f8d3d-b04f-4515-b953-a5422d69b0a8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:01.287377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f8d3d-b04f-4515-b953-a5422d69b0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:01.352389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-892f8d3d-b04f-4515-b953-a5422d69b0a8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:01.353586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-892f8d3d-b04f-4515-b953-a5422d69b0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:01.361671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:01.447946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:01.485200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd00d5-8c4d-45f4-ae52-b09ab175aed4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:01.486718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-83dd00d5-8c4d-45f4-ae52-b09ab175aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:01.592153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd00d5-8c4d-45f4-ae52-b09ab175aed4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:01.646451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:01.664469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a679242-792d-4129-a74d-1df851a22196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:01.665089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679242-792d-4129-a74d-1df851a22196 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:01.665370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679242-792d-4129-a74d-1df851a22196 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:01.665646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679242-792d-4129-a74d-1df851a22196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:01.667315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5a679242-792d-4129-a74d-1df851a22196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:01.773730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a679242-792d-4129-a74d-1df851a22196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:01.775205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a679242-792d-4129-a74d-1df851a22196 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:01.792733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 742/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:03.824716 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e068c-4a50-48f9-8a30-02a71d1e4b1c None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:03.825256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e068c-4a50-48f9-8a30-02a71d1e4b1c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:03.825256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e068c-4a50-48f9-8a30-02a71d1e4b1c None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:03.826608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:03.831973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68757a-9558-4159-a528-df5b5406d794 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:03.832364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68757a-9558-4159-a528-df5b5406d794 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:03.832539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68757a-9558-4159-a528-df5b5406d794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:03.898317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-fe68757a-9558-4159-a528-df5b5406d794 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:03.899538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fe68757a-9558-4159-a528-df5b5406d794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:03.938073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:03.996058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:04.033960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e068c-4a50-48f9-8a30-02a71d1e4b1c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:04.035561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4e9e068c-4a50-48f9-8a30-02a71d1e4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:04.136137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e068c-4a50-48f9-8a30-02a71d1e4b1c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:04.173645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:04.209029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e2665-8d45-4b2c-8142-a132c7cfb050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:04.209640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e2665-8d45-4b2c-8142-a132c7cfb050 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:04.209920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e2665-8d45-4b2c-8142-a132c7cfb050 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:04.210192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e2665-8d45-4b2c-8142-a132c7cfb050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:04.211843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6f6e2665-8d45-4b2c-8142-a132c7cfb050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:04.317437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e2665-8d45-4b2c-8142-a132c7cfb050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:04.318853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e2665-8d45-4b2c-8142-a132c7cfb050 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:04.336994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 721/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:06.358378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431f04-0e3c-4d1b-ba2c-ce047655d82b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:06.358821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431f04-0e3c-4d1b-ba2c-ce047655d82b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:06.359092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431f04-0e3c-4d1b-ba2c-ce047655d82b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:06.360861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:06.366103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a17ed-3003-486b-a08b-c31376b0876b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:06.366566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a17ed-3003-486b-a08b-c31376b0876b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:06.366669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a17ed-3003-486b-a08b-c31376b0876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:06.433539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-322a17ed-3003-486b-a08b-c31376b0876b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:06.434743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-322a17ed-3003-486b-a08b-c31376b0876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:06.453211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:06.532036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:06.569575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431f04-0e3c-4d1b-ba2c-ce047655d82b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:06.571186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-28431f04-0e3c-4d1b-ba2c-ce047655d82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:06.674601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431f04-0e3c-4d1b-ba2c-ce047655d82b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:06.741095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:06.748305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a61961-86fe-4e67-a0f4-dd813845d840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:06.748922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61961-86fe-4e67-a0f4-dd813845d840 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:06.749205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61961-86fe-4e67-a0f4-dd813845d840 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:06.749478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61961-86fe-4e67-a0f4-dd813845d840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:06.751171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b7a61961-86fe-4e67-a0f4-dd813845d840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:06.865601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a61961-86fe-4e67-a0f4-dd813845d840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:06.867091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a61961-86fe-4e67-a0f4-dd813845d840 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:06.885394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 745/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:08.888141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad78c15-c3f3-4013-8640-e7c7a6382251 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:08.888687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad78c15-c3f3-4013-8640-e7c7a6382251 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:08.888687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad78c15-c3f3-4013-8640-e7c7a6382251 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:08.890036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:08.896052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e3bd-a6dd-4d23-9478-def8e6d0e1e8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:08.896475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e3bd-a6dd-4d23-9478-def8e6d0e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:08.896594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e3bd-a6dd-4d23-9478-def8e6d0e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:08.961159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a6c9e3bd-a6dd-4d23-9478-def8e6d0e1e8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:08.962360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a6c9e3bd-a6dd-4d23-9478-def8e6d0e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:09.009844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:09.058498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:09.095450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad78c15-c3f3-4013-8640-e7c7a6382251 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:09.097071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3ad78c15-c3f3-4013-8640-e7c7a6382251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:09.200212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad78c15-c3f3-4013-8640-e7c7a6382251 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:09.246735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:09.273769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93a2ad-50bc-4de3-a15a-7f8c1740b601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:09.274386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93a2ad-50bc-4de3-a15a-7f8c1740b601 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:09.274681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93a2ad-50bc-4de3-a15a-7f8c1740b601 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:09.274974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93a2ad-50bc-4de3-a15a-7f8c1740b601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:09.276603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2f93a2ad-50bc-4de3-a15a-7f8c1740b601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:09.385322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93a2ad-50bc-4de3-a15a-7f8c1740b601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:09.386757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93a2ad-50bc-4de3-a15a-7f8c1740b601 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:09.405006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 724/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:19.056632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=22 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:19.402712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=66 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:28.726565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837114f-9fc4-407d-bc00-aee7901a3cf5 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:28.727118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837114f-9fc4-407d-bc00-aee7901a3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:28.727236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837114f-9fc4-407d-bc00-aee7901a3cf5 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:28.728554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 747/1471] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:28.733726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15244e-130c-42cd-a892-d474a4c9f6ac None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:28.734145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15244e-130c-42cd-a892-d474a4c9f6ac None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:28.734283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15244e-130c-42cd-a892-d474a4c9f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:28.798605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5e15244e-130c-42cd-a892-d474a4c9f6ac None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:28.799872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5e15244e-130c-42cd-a892-d474a4c9f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:28.898585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 725/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:28.984313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621647c7-1b47-46f4-ab1d-7fcbe3cefad3 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:28.984604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621647c7-1b47-46f4-ab1d-7fcbe3cefad3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:28.984951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621647c7-1b47-46f4-ab1d-7fcbe3cefad3 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:28.986341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 748/1473] 10.222.0.46 () {54 vars in 966 bytes} [Tue Jul 26 07:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:28.991233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a88e0-89f9-48f9-8581-2bef86650a3d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:28.991525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a88e0-89f9-48f9-8581-2bef86650a3d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:28.991807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a88e0-89f9-48f9-8581-2bef86650a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:29.067409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-129a88e0-89f9-48f9-8581-2bef86650a3d None None] MFA Rules not processed for user `bde6248cf0794fab88a093097b597c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:29.068617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-129a88e0-89f9-48f9-8581-2bef86650a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:29.088935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:29.143443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 726/1474] 10.222.0.46 () {58 vars in 1063 bytes} [Tue Jul 26 07:46:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:29.150953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621647c7-1b47-46f4-ab1d-7fcbe3cefad3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:29.152481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-621647c7-1b47-46f4-ab1d-7fcbe3cefad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:29.255177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621647c7-1b47-46f4-ab1d-7fcbe3cefad3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:29.329212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5551d3d-4a64-4f87-95dd-056853f121a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde6248cf0794fab88a093097b597c9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:29.329920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551d3d-4a64-4f87-95dd-056853f121a2 service glance] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:29.330104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551d3d-4a64-4f87-95dd-056853f121a2 service glance] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:29.330376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551d3d-4a64-4f87-95dd-056853f121a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:29.332020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d5551d3d-4a64-4f87-95dd-056853f121a2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:29.384350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:29.440149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5551d3d-4a64-4f87-95dd-056853f121a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:29.441595 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5551d3d-4a64-4f87-95dd-056853f121a2 service glance] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:29.459576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 749/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:31.533445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15b92-8245-4fec-8bfa-5d51ec9a09b0 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:31.533994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15b92-8245-4fec-8bfa-5d51ec9a09b0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:31.534093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15b92-8245-4fec-8bfa-5d51ec9a09b0 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:31.535563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 727/1476] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:46:31.540875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ef66-c37d-4c12-9190-25d5bb64ba62 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:31.541292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ef66-c37d-4c12-9190-25d5bb64ba62 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:31.541425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ef66-c37d-4c12-9190-25d5bb64ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:31.606629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ddc1ef66-c37d-4c12-9190-25d5bb64ba62 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:31.607881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ddc1ef66-c37d-4c12-9190-25d5bb64ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:31.704212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 750/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:31.727565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15b92-8245-4fec-8bfa-5d51ec9a09b0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:31.729097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e1c15b92-8245-4fec-8bfa-5d51ec9a09b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:31.853121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15b92-8245-4fec-8bfa-5d51ec9a09b0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:31.901578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:31.946008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bd227-2066-4751-b701-e93684efd51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:31.946630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd227-2066-4751-b701-e93684efd51c admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:31.946911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd227-2066-4751-b701-e93684efd51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:31.947219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd227-2066-4751-b701-e93684efd51c admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:31.947918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bd227-2066-4751-b701-e93684efd51c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:31.949655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING py.warnings [None req-e24bd227-2066-4751-b701-e93684efd51c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:46:31.949655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: warnings.warn(msg) Jul 26 07:46:31.949655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: Jul 26 07:46:31.950793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bd227-2066-4751-b701-e93684efd51c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:31.970243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 728/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jul 26 07:46:31 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:46:33.993497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975282b-323a-41ca-8994-fcc77939be4b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:33.994064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975282b-323a-41ca-8994-fcc77939be4b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:33.994064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975282b-323a-41ca-8994-fcc77939be4b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:33.995492 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 751/1479] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:34.000651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e756-e081-4eae-ac0b-e93a149bccea None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:34.001080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e756-e081-4eae-ac0b-e93a149bccea None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:34.001195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e756-e081-4eae-ac0b-e93a149bccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:34.069360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0222e756-e081-4eae-ac0b-e93a149bccea None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:34.070568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0222e756-e081-4eae-ac0b-e93a149bccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:34.171021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 729/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:46:34.214657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975282b-323a-41ca-8994-fcc77939be4b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:34.216327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8975282b-323a-41ca-8994-fcc77939be4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:34.226581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:34.362953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975282b-323a-41ca-8994-fcc77939be4b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:34.443154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:34.475898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97391b-07e2-4db1-a818-e57ad8060281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:34.476518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97391b-07e2-4db1-a818-e57ad8060281 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:34.476799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97391b-07e2-4db1-a818-e57ad8060281 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:34.477071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97391b-07e2-4db1-a818-e57ad8060281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:34.478697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5e97391b-07e2-4db1-a818-e57ad8060281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:34.569056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97391b-07e2-4db1-a818-e57ad8060281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:34.570658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97391b-07e2-4db1-a818-e57ad8060281 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:34.588985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 752/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:36.760252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6c1a-d9d4-4e37-a075-6c290b9f097e None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:36.760889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6c1a-d9d4-4e37-a075-6c290b9f097e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:36.760889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6c1a-d9d4-4e37-a075-6c290b9f097e None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:36.762172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 730/1482] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:36.767811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c747a0-143b-4512-a75e-80ec3abf8b8e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:36.768260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c747a0-143b-4512-a75e-80ec3abf8b8e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:36.768368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c747a0-143b-4512-a75e-80ec3abf8b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:36.832869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-37c747a0-143b-4512-a75e-80ec3abf8b8e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:36.834070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-37c747a0-143b-4512-a75e-80ec3abf8b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:36.880853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:36.931264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 753/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:46:36.968018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6c1a-d9d4-4e37-a075-6c290b9f097e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:36.970218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b6dc6c1a-d9d4-4e37-a075-6c290b9f097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:36.993600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:37.075747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6c1a-d9d4-4e37-a075-6c290b9f097e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:37.147770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebfd7e-efae-4381-a6b0-4a4fad396628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:37.148381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfd7e-efae-4381-a6b0-4a4fad396628 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:37.148663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfd7e-efae-4381-a6b0-4a4fad396628 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:37.148937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfd7e-efae-4381-a6b0-4a4fad396628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:37.150560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-25ebfd7e-efae-4381-a6b0-4a4fad396628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:37.223288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:37.257239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebfd7e-efae-4381-a6b0-4a4fad396628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:37.258668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebfd7e-efae-4381-a6b0-4a4fad396628 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:37.276995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 731/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:39.307028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5f69a-c647-42f0-bdeb-05b18bd58f82 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:39.307680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5f69a-c647-42f0-bdeb-05b18bd58f82 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:39.307680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5f69a-c647-42f0-bdeb-05b18bd58f82 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:39.309031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 754/1485] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:39.314314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954072-0b5f-416d-8c8d-1e0e4c34afd2 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:39.314739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954072-0b5f-416d-8c8d-1e0e4c34afd2 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:39.314864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954072-0b5f-416d-8c8d-1e0e4c34afd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:39.379388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-6a954072-0b5f-416d-8c8d-1e0e4c34afd2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:39.380849 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6a954072-0b5f-416d-8c8d-1e0e4c34afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:39.475252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 732/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:39.512633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5f69a-c647-42f0-bdeb-05b18bd58f82 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:39.514181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2fc5f69a-c647-42f0-bdeb-05b18bd58f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:39.619618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5f69a-c647-42f0-bdeb-05b18bd58f82 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:39.690043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:39.691945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab9416-08e2-49b2-965c-ccc5361e8a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:39.692571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab9416-08e2-49b2-965c-ccc5361e8a61 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:39.693091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab9416-08e2-49b2-965c-ccc5361e8a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:39.693550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab9416-08e2-49b2-965c-ccc5361e8a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:39.695438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c3ab9416-08e2-49b2-965c-ccc5361e8a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:39.803486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab9416-08e2-49b2-965c-ccc5361e8a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:39.804910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab9416-08e2-49b2-965c-ccc5361e8a61 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:39.822231 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 755/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:41.957129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e27f4-c0c9-4bf8-b81e-b490b5ddfbca None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:41.957676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e27f4-c0c9-4bf8-b81e-b490b5ddfbca None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:41.957676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e27f4-c0c9-4bf8-b81e-b490b5ddfbca None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:41.959063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 733/1488] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:41.964163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4ca3-0bfe-4a1c-b3e1-af0257619efa None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:41.964594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4ca3-0bfe-4a1c-b3e1-af0257619efa None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:41.964709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4ca3-0bfe-4a1c-b3e1-af0257619efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:42.030652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ea3a4ca3-0bfe-4a1c-b3e1-af0257619efa None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:42.031905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ea3a4ca3-0bfe-4a1c-b3e1-af0257619efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:42.084391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:42.128200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 756/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:42.168685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e27f4-c0c9-4bf8-b81e-b490b5ddfbca None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:42.170261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-819e27f4-c0c9-4bf8-b81e-b490b5ddfbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:42.207710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:42.276407 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e27f4-c0c9-4bf8-b81e-b490b5ddfbca None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:42.347624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65dace-4cc4-4702-8d1b-fe9b9b29f382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:42.348245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65dace-4cc4-4702-8d1b-fe9b9b29f382 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:42.348527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65dace-4cc4-4702-8d1b-fe9b9b29f382 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:42.348804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65dace-4cc4-4702-8d1b-fe9b9b29f382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:42.350434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ed65dace-4cc4-4702-8d1b-fe9b9b29f382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:42.431282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:42.460684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65dace-4cc4-4702-8d1b-fe9b9b29f382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:42.462123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65dace-4cc4-4702-8d1b-fe9b9b29f382 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:42.479831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 734/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:44.694651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a4212-73e8-405b-9630-5a658922f51a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:44.695200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a4212-73e8-405b-9630-5a658922f51a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:44.695297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a4212-73e8-405b-9630-5a658922f51a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:44.696628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 757/1491] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jul 26 07:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:46:44.701762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18ee51-4a17-4ae8-b29b-3eb7f6cff75e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:44.702163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18ee51-4a17-4ae8-b29b-3eb7f6cff75e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:44.702326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18ee51-4a17-4ae8-b29b-3eb7f6cff75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:44.768329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0a18ee51-4a17-4ae8-b29b-3eb7f6cff75e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:46:44.769549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0a18ee51-4a17-4ae8-b29b-3eb7f6cff75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:44.865591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 735/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jul 26 07:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:46:44.905803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a4212-73e8-405b-9630-5a658922f51a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:46:44.907489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ea0a4212-73e8-405b-9630-5a658922f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:45.008370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a4212-73e8-405b-9630-5a658922f51a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:46:45.082387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d73018-e200-49e1-a7b9-cd1bf95b5767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:46:45.083038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73018-e200-49e1-a7b9-cd1bf95b5767 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:46:45.083322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73018-e200-49e1-a7b9-cd1bf95b5767 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:46:45.083590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73018-e200-49e1-a7b9-cd1bf95b5767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:46:45.085225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-47d73018-e200-49e1-a7b9-cd1bf95b5767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:46:45.094252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:45.193666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d73018-e200-49e1-a7b9-cd1bf95b5767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:46:45.195193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d73018-e200-49e1-a7b9-cd1bf95b5767 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:46:45.212615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 758/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:46:54.863769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=82 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:46:55.210383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=50 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:11.164721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0d51-e49c-4f66-ad18-79f3f16a044b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:11.165296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0d51-e49c-4f66-ad18-79f3f16a044b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:11.165296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0d51-e49c-4f66-ad18-79f3f16a044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:11.240327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-977a0d51-e49c-4f66-ad18-79f3f16a044b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:48:11.241523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-977a0d51-e49c-4f66-ad18-79f3f16a044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:11.335141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 736/1494] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:48:11.343892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a41a-e837-4238-a994-1781b264e670 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:11.344396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a41a-e837-4238-a994-1781b264e670 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:11.344505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a41a-e837-4238-a994-1781b264e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:11.420292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-6f01a41a-e837-4238-a994-1781b264e670 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:48:11.421422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6f01a41a-e837-4238-a994-1781b264e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:11.518158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 759/1495] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:48:11.524405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0d51-e49c-4f66-ad18-79f3f16a044b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:11.525587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-977a0d51-e49c-4f66-ad18-79f3f16a044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:11.538152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0d51-e49c-4f66-ad18-79f3f16a044b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:11.599264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:11.632252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:11.632868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:11.633149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:11.633421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:11.634112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:48:11.634413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:11.635463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING py.warnings [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:48:11.635463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: warnings.warn(msg) Jul 26 07:48:11.635463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: Jul 26 07:48:11.636342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:11.648133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 737/1496] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:48:11.657052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a41a-e837-4238-a994-1781b264e670 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:11.666181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a41a-e837-4238-a994-1781b264e670 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:11.725550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:11.758013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:11.758626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:11.758903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:11.759202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:11.759866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:11.761588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING py.warnings [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:48:11.761588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: warnings.warn(msg) Jul 26 07:48:11.761588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: Jul 26 07:48:11.763310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:11.817541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 760/1497] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:48:11 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:48:11.821865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:11.823428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:11.859135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7817-5b07-4c06-b35f-7855da349cc1 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:11.952543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:11.953169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:11.953451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:11.953726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:11.954391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:11.955432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING py.warnings [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:48:11.955432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: warnings.warn(msg) Jul 26 07:48:11.955432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: Jul 26 07:48:11.956640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:11.996490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 738/1498] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:48:11 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:48:12.001263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:12.002790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:12.064563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7250c-04d5-4c5d-8f54-0473abb30a81 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:12.149122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:12.161759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:12.162390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:12.162666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:12.162948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:12.163678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:12.164697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING py.warnings [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:48:12.164697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: warnings.warn(msg) Jul 26 07:48:12.164697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: Jul 26 07:48:12.165579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:12.178937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 761/1499] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:48:12.183176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:12.185411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:12.197238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8605d-3229-487f-bdae-e4051d1ebe22 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:12.223724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:12.299337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a5079-6e32-4b10-9182-eeeb77375eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:12.299883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a5079-6e32-4b10-9182-eeeb77375eae admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:12.300166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a5079-6e32-4b10-9182-eeeb77375eae admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:12.300440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a5079-6e32-4b10-9182-eeeb77375eae admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:12.301145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a5079-6e32-4b10-9182-eeeb77375eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:12.302164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING py.warnings [None req-845a5079-6e32-4b10-9182-eeeb77375eae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:48:12.302164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: warnings.warn(msg) Jul 26 07:48:12.302164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: Jul 26 07:48:12.303085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a5079-6e32-4b10-9182-eeeb77375eae admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:12.319357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 739/1500] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:48:12.320588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:12.322143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:12.357724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30dc3-f958-4a61-ab70-aa30f29a17a3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:12.454339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b5c07-0a54-4427-9187-3d9ec526980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:12.455050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5c07-0a54-4427-9187-3d9ec526980c admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:12.455337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5c07-0a54-4427-9187-3d9ec526980c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:12.455614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5c07-0a54-4427-9187-3d9ec526980c admin admin] PATH_INFO: `/v3/projects/ce9d33b8291143d794a267611ef6aa94/users/2faac5b2adcd498096b01e6ea7b2f68e/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:12.477289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b5c07-0a54-4427-9187-3d9ec526980c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9d33b8291143d794a267611ef6aa94, user_id=2faac5b2adcd498096b01e6ea7b2f68e, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:12.478328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING py.warnings [None req-b98b5c07-0a54-4427-9187-3d9ec526980c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:48:12.478328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: warnings.warn(msg) Jul 26 07:48:12.478328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: Jul 26 07:48:12.480313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b5c07-0a54-4427-9187-3d9ec526980c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:12.505105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 762/1501] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:48:12 2022] PUT /identity/v3/projects/ce9d33b8291143d794a267611ef6aa94/users/2faac5b2adcd498096b01e6ea7b2f68e/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:48:12.517260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa0f1f-a964-4256-ab1d-c490cbd70ebf None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:12.517549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa0f1f-a964-4256-ab1d-c490cbd70ebf None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:12.517846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa0f1f-a964-4256-ab1d-c490cbd70ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:12.575157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-76fa0f1f-a964-4256-ab1d-c490cbd70ebf None None] MFA Rules not processed for user `2faac5b2adcd498096b01e6ea7b2f68e`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:48:12.576311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-76fa0f1f-a964-4256-ab1d-c490cbd70ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:12.652597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 740/1502] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:48:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:48:12.665987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b714f-3c71-4213-9fb1-1eb05a8e1292 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:12.666255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b714f-3c71-4213-9fb1-1eb05a8e1292 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:12.666529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b714f-3c71-4213-9fb1-1eb05a8e1292 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:12.667915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 763/1503] 10.222.0.46 () {54 vars in 964 bytes} [Tue Jul 26 07:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:48:12.673428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143b5b-631c-4d79-ad18-2d105d786c34 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:12.673720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143b5b-631c-4d79-ad18-2d105d786c34 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:12.674003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143b5b-631c-4d79-ad18-2d105d786c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:12.705000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:12.752781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-27143b5b-631c-4d79-ad18-2d105d786c34 None None] MFA Rules not processed for user `c1886d36711f4ca48191ebfbee3e9a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:48:12.753985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-27143b5b-631c-4d79-ad18-2d105d786c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:12.834510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 741/1504] 10.222.0.46 () {58 vars in 1061 bytes} [Tue Jul 26 07:48:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:48:12.842808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b714f-3c71-4213-9fb1-1eb05a8e1292 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:12.844381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e58b714f-3c71-4213-9fb1-1eb05a8e1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:12.894314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:12.950357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b714f-3c71-4213-9fb1-1eb05a8e1292 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:13.022005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:13.022621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:13.022916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:13.023215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:13.024846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:13.121846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:13.123239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:13.126721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:13.143097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 764/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:48:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:48:13.187787 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13d929-2280-45d8-aa89-ee0bf4d0a623 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:13.188226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13d929-2280-45d8-aa89-ee0bf4d0a623 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:13.188331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13d929-2280-45d8-aa89-ee0bf4d0a623 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:13.189595 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 742/1506] 10.222.0.46 () {52 vars in 830 bytes} [Tue Jul 26 07:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:48:13.193077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:13.194278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:13.291779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912111-c711-498a-b8c7-f1cfb373ac37 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:13.385553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:13.386152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:13.386401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:13.386672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] PATH_INFO: `/v3/users/2faac5b2adcd498096b01e6ea7b2f68e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:13.399917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2faac5b2adcd498096b01e6ea7b2f68e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:13.400947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING py.warnings [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:48:13.400947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: warnings.warn(msg) Jul 26 07:48:13.400947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: Jul 26 07:48:13.402159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:13.412179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:13.464941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2faac5b2adcd498096b01e6ea7b2f68e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:13.474269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2faac5b2adcd498096b01e6ea7b2f68e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:13.486040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2faac5b2adcd498096b01e6ea7b2f68e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:13.486480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2faac5b2adcd498096b01e6ea7b2f68e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:13.505178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2faac5b2adcd498096b01e6ea7b2f68e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:13.510795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 765/1507] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:48:13 2022] DELETE /identity/v3/users/2faac5b2adcd498096b01e6ea7b2f68e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:48:13.516249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa29e-9b50-42ef-8d9a-9841b4d6d98f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:13.516536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa29e-9b50-42ef-8d9a-9841b4d6d98f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:13.516814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa29e-9b50-42ef-8d9a-9841b4d6d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:13.571908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b9ffa29e-9b50-42ef-8d9a-9841b4d6d98f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:48:13.573107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b9ffa29e-9b50-42ef-8d9a-9841b4d6d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:13.651827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:13.665034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 743/1508] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:48:13.675675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:13.676980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:13.774758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91a5e-195e-452a-a9c6-6f4c474df5ac admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:13.828371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:13.849272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe81f1-eebb-4d03-a853-18150eca23ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:13.849905 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe81f1-eebb-4d03-a853-18150eca23ee service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:13.850194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe81f1-eebb-4d03-a853-18150eca23ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:13.850471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe81f1-eebb-4d03-a853-18150eca23ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:13.852141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fbbe81f1-eebb-4d03-a853-18150eca23ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:13.960696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe81f1-eebb-4d03-a853-18150eca23ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:13.962075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe81f1-eebb-4d03-a853-18150eca23ee service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:13.980650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 766/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:48:14.302878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa29e-9b50-42ef-8d9a-9841b4d6d98f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:48:14.304213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b9ffa29e-9b50-42ef-8d9a-9841b4d6d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:48:14.316146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa29e-9b50-42ef-8d9a-9841b4d6d98f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:48:14.414945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:48:14.415596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:48:14.415875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:48:14.416155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] PATH_INFO: `/v3/projects/ce9d33b8291143d794a267611ef6aa94` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:48:14.426236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9d33b8291143d794a267611ef6aa94)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:48:14.427298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING py.warnings [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:48:14.427298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: warnings.warn(msg) Jul 26 07:48:14.427298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: Jul 26 07:48:14.428485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:48:14.485627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9d33b8291143d794a267611ef6aa94', 'request_id': 'req-44552c31-4aee-4e7f-9a3a-2d37906b059b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:14.499211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9d33b8291143d794a267611ef6aa94', 'request_id': 'req-44552c31-4aee-4e7f-9a3a-2d37906b059b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:14.507761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9d33b8291143d794a267611ef6aa94', 'request_id': 'req-44552c31-4aee-4e7f-9a3a-2d37906b059b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:14.530218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] The token cache is being invalidate because project ce9d33b8291143d794a267611ef6aa94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:48:14.530514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:14.531063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-44552c31-4aee-4e7f-9a3a-2d37906b059b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:48:14.532396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 744/1510] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:48:14 2022] DELETE /identity/v3/projects/ce9d33b8291143d794a267611ef6aa94 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:48:23.978381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=62 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:48:24.528652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:53.971253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90437c3c-853c-41a8-814d-05a570fd140c None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:49:53.971841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90437c3c-853c-41a8-814d-05a570fd140c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:49:53.971841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90437c3c-853c-41a8-814d-05a570fd140c None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:49:53.973156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:49:53.978030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607e7fc-e6c7-43f6-91a0-8b8bfc881eb3 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:49:53.978440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607e7fc-e6c7-43f6-91a0-8b8bfc881eb3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:49:53.978597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607e7fc-e6c7-43f6-91a0-8b8bfc881eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:49:54.060204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-6607e7fc-e6c7-43f6-91a0-8b8bfc881eb3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:49:54.061427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6607e7fc-e6c7-43f6-91a0-8b8bfc881eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:49:54.164082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:49:54.319003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90437c3c-853c-41a8-814d-05a570fd140c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:49:54.321112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-90437c3c-853c-41a8-814d-05a570fd140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:49:54.437832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90437c3c-853c-41a8-814d-05a570fd140c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:49:54.444070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7e77d-d09c-431a-a29a-cd0f8120d0d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:49:54.444716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7e77d-d09c-431a-a29a-cd0f8120d0d8 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:49:54.444996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7e77d-d09c-431a-a29a-cd0f8120d0d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:49:54.445269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7e77d-d09c-431a-a29a-cd0f8120d0d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:49:54.453477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7e77d-d09c-431a-a29a-cd0f8120d0d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:49:54.455091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7e77d-d09c-431a-a29a-cd0f8120d0d8 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:49:54.464723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 768/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:49:55.287558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701ff72-4af8-49a3-b681-7c2d8113caeb None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:49:55.288117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701ff72-4af8-49a3-b681-7c2d8113caeb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:49:55.288117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701ff72-4af8-49a3-b681-7c2d8113caeb None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:49:55.289488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:49:55.294392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0321c3-ba8f-4a67-a265-838ed1063a11 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:49:55.294828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0321c3-ba8f-4a67-a265-838ed1063a11 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:49:55.294986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0321c3-ba8f-4a67-a265-838ed1063a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:49:55.314491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ae0321c3-ba8f-4a67-a265-838ed1063a11 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:49:55.315719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ae0321c3-ba8f-4a67-a265-838ed1063a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:49:55.324033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:49:55.473555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701ff72-4af8-49a3-b681-7c2d8113caeb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:49:55.488482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701ff72-4af8-49a3-b681-7c2d8113caeb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:49:55.493843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4cd79-14b0-4df8-8595-91d1afcf1d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:49:55.494450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cd79-14b0-4df8-8595-91d1afcf1d9d service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:49:55.494734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cd79-14b0-4df8-8595-91d1afcf1d9d service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:49:55.495044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cd79-14b0-4df8-8595-91d1afcf1d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:49:55.503067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4cd79-14b0-4df8-8595-91d1afcf1d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:49:55.504650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4cd79-14b0-4df8-8595-91d1afcf1d9d service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:49:55.514180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 747/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:49:56.023462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1df3-1f35-4312-83c9-a7ffe9747c65 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:49:56.023746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1df3-1f35-4312-83c9-a7ffe9747c65 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:49:56.024021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1df3-1f35-4312-83c9-a7ffe9747c65 None None] PATH_INFO: `/v3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:49:56.025332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 770/1517] 10.222.0.49 () {54 vars in 925 bytes} [Tue Jul 26 07:49:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:49:56.031555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7784d-079b-498f-bff5-70a0f6923563 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:49:56.031849 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7784d-079b-498f-bff5-70a0f6923563 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:49:56.032132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7784d-079b-498f-bff5-70a0f6923563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:49:56.090354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-75b7784d-079b-498f-bff5-70a0f6923563 None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:49:56.091591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-75b7784d-079b-498f-bff5-70a0f6923563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:49:56.107857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:49:56.162606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 748/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jul 26 07:49:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:50:05.194572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd4bc-558e-48c4-a197-afb5cb3c8375 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:05.195207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd4bc-558e-48c4-a197-afb5cb3c8375 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:05.195307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd4bc-558e-48c4-a197-afb5cb3c8375 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:05.196585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 771/1519] 10.222.0.46 () {54 vars in 961 bytes} [Tue Jul 26 07:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:50:05.202587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ac05-97f7-406f-a616-9938e83c7133 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:05.203470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ac05-97f7-406f-a616-9938e83c7133 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:05.203750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ac05-97f7-406f-a616-9938e83c7133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:05.225499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9223ac05-97f7-406f-a616-9938e83c7133 None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:50:05.226740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9223ac05-97f7-406f-a616-9938e83c7133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:05.235494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 749/1520] 10.222.0.46 () {58 vars in 1058 bytes} [Tue Jul 26 07:50:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:50:05.243333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbd4bc-558e-48c4-a197-afb5cb3c8375 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:50:05.257303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbd4bc-558e-48c4-a197-afb5cb3c8375 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:50:05.262887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a9332-8ca2-4482-a1b3-12b98e525581 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:50:05.263543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a9332-8ca2-4482-a1b3-12b98e525581 service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:05.264086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a9332-8ca2-4482-a1b3-12b98e525581 service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:05.264360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a9332-8ca2-4482-a1b3-12b98e525581 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:05.272909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a9332-8ca2-4482-a1b3-12b98e525581 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:50:05.274481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a9332-8ca2-4482-a1b3-12b98e525581 service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:50:05.284006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 772/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:50:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:50:06.739679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71c118-dfc6-4066-b9f3-6c6cc8b053e9 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:06.740215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71c118-dfc6-4066-b9f3-6c6cc8b053e9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:06.740215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71c118-dfc6-4066-b9f3-6c6cc8b053e9 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:06.741516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:50:06.746885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac5b5-6092-4f73-9f4b-69277c52b5f8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:06.747334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac5b5-6092-4f73-9f4b-69277c52b5f8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:06.747481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ac5b5-6092-4f73-9f4b-69277c52b5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:06.767443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-dc2ac5b5-6092-4f73-9f4b-69277c52b5f8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:50:06.768683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dc2ac5b5-6092-4f73-9f4b-69277c52b5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:06.776562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:50:06.929582 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71c118-dfc6-4066-b9f3-6c6cc8b053e9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:50:06.944586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71c118-dfc6-4066-b9f3-6c6cc8b053e9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:50:06.950025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ae076-156f-42db-a52f-102427c8faeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:50:06.950632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ae076-156f-42db-a52f-102427c8faeb service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:06.950912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ae076-156f-42db-a52f-102427c8faeb service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:06.951217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ae076-156f-42db-a52f-102427c8faeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:06.959468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ae076-156f-42db-a52f-102427c8faeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:50:06.961119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ae076-156f-42db-a52f-102427c8faeb service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:50:06.970521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 751/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:50:07.779609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b34e6-2e0e-4b69-ac04-3d663b72869a None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:07.780292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b34e6-2e0e-4b69-ac04-3d663b72869a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:07.780292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b34e6-2e0e-4b69-ac04-3d663b72869a None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:07.781516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 07:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:50:07.786239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878e55-0273-44a7-bbd7-29b46c000e68 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:07.786701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878e55-0273-44a7-bbd7-29b46c000e68 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:07.786809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878e55-0273-44a7-bbd7-29b46c000e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:07.805510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f6878e55-0273-44a7-bbd7-29b46c000e68 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:50:07.806697 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f6878e55-0273-44a7-bbd7-29b46c000e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:07.814413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 07:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:50:07.962972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b34e6-2e0e-4b69-ac04-3d663b72869a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:50:07.977575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b34e6-2e0e-4b69-ac04-3d663b72869a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:50:07.983263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c2c8e-7278-4f2e-9acb-47626511157e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:50:07.983866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2c8e-7278-4f2e-9acb-47626511157e service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:07.984147 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2c8e-7278-4f2e-9acb-47626511157e service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:07.984420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2c8e-7278-4f2e-9acb-47626511157e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:07.992381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c2c8e-7278-4f2e-9acb-47626511157e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:50:07.993947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c2c8e-7278-4f2e-9acb-47626511157e service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:50:08.003795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 775/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:50:11.771449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2660f-1b30-4a21-85dd-0d39d5b380d8 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:11.772019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2660f-1b30-4a21-85dd-0d39d5b380d8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:11.772019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2660f-1b30-4a21-85dd-0d39d5b380d8 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:11.773375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:50:11.779144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b012dc-437a-459c-8713-e5666c2e4e63 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:11.779625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b012dc-437a-459c-8713-e5666c2e4e63 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:11.779744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b012dc-437a-459c-8713-e5666c2e4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:11.799344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-00b012dc-437a-459c-8713-e5666c2e4e63 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:50:11.800540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-00b012dc-437a-459c-8713-e5666c2e4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:11.808391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:50:11.879843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2660f-1b30-4a21-85dd-0d39d5b380d8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:50:11.881567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-36b2660f-1b30-4a21-85dd-0d39d5b380d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:11.958844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2660f-1b30-4a21-85dd-0d39d5b380d8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:50:11.962419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1ab13-1cec-4e5c-a321-20883652e504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:50:11.963066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ab13-1cec-4e5c-a321-20883652e504 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:11.963350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ab13-1cec-4e5c-a321-20883652e504 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:11.963625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ab13-1cec-4e5c-a321-20883652e504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:11.972923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1ab13-1cec-4e5c-a321-20883652e504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:50:11.974356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1ab13-1cec-4e5c-a321-20883652e504 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:50:11.984187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 754/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:50:13.968817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5465-0f4a-4989-b64a-be89deb99e58 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:13.969371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5465-0f4a-4989-b64a-be89deb99e58 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:13.969371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5465-0f4a-4989-b64a-be89deb99e58 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:13.970769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:50:13.975996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9cd8-adb7-446a-aaf5-f037c986f14b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:13.976421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9cd8-adb7-446a-aaf5-f037c986f14b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:13.976542 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9cd8-adb7-446a-aaf5-f037c986f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:13.996920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7d6f9cd8-adb7-446a-aaf5-f037c986f14b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:50:13.998104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7d6f9cd8-adb7-446a-aaf5-f037c986f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:14.005809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:50:14.043721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5465-0f4a-4989-b64a-be89deb99e58 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:50:14.054565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5465-0f4a-4989-b64a-be89deb99e58 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:50:14.058158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cab4b-f94b-4e5d-8a43-928311dbba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:50:14.058766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cab4b-f94b-4e5d-8a43-928311dbba5d service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:14.059095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cab4b-f94b-4e5d-8a43-928311dbba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:14.059372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cab4b-f94b-4e5d-8a43-928311dbba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:14.068207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cab4b-f94b-4e5d-8a43-928311dbba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:50:14.069639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cab4b-f94b-4e5d-8a43-928311dbba5d service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:50:14.079091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 778/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:50:17.534255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc088-65b8-43a2-ab08-6c5fafe93a50 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:17.534825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc088-65b8-43a2-ab08-6c5fafe93a50 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:17.534825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc088-65b8-43a2-ab08-6c5fafe93a50 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:17.536209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:50:17.541273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e2358-2857-44bf-8573-41bf0b72f40d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:17.541733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e2358-2857-44bf-8573-41bf0b72f40d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:17.541830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e2358-2857-44bf-8573-41bf0b72f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:17.560899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-d49e2358-2857-44bf-8573-41bf0b72f40d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:50:17.562103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d49e2358-2857-44bf-8573-41bf0b72f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:17.569954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:50:17.869708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bc088-65b8-43a2-ab08-6c5fafe93a50 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:50:17.871912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3e5bc088-65b8-43a2-ab08-6c5fafe93a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:17.935805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:50:17.953638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bc088-65b8-43a2-ab08-6c5fafe93a50 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:50:17.961084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a309-651a-4e02-93f8-ec5423298752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:50:17.961697 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a309-651a-4e02-93f8-ec5423298752 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:17.961977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a309-651a-4e02-93f8-ec5423298752 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:17.962249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a309-651a-4e02-93f8-ec5423298752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:17.975050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1a309-651a-4e02-93f8-ec5423298752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:50:17.976471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1a309-651a-4e02-93f8-ec5423298752 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:50:17.985607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 757/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:50:20.002014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4649e95-a84e-4718-ad6e-7bed751bcde7 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:20.002541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4649e95-a84e-4718-ad6e-7bed751bcde7 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:20.002541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4649e95-a84e-4718-ad6e-7bed751bcde7 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:20.003989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 07:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:50:20.009217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6770-62f5-4f33-9c00-d6a63515349c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:20.009629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6770-62f5-4f33-9c00-d6a63515349c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:20.009786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6770-62f5-4f33-9c00-d6a63515349c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:20.029782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-201e6770-62f5-4f33-9c00-d6a63515349c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:50:20.031011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-201e6770-62f5-4f33-9c00-d6a63515349c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:20.039330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 07:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:50:20.340191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4649e95-a84e-4718-ad6e-7bed751bcde7 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:50:20.341886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b4649e95-a84e-4718-ad6e-7bed751bcde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:50:20.354770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4649e95-a84e-4718-ad6e-7bed751bcde7 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:50:20.358836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be3a42-d0cc-4332-a5bd-e3bb7a3ebefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:50:20.359466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3a42-d0cc-4332-a5bd-e3bb7a3ebefa service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:50:20.359745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3a42-d0cc-4332-a5bd-e3bb7a3ebefa service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:50:20.360015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3a42-d0cc-4332-a5bd-e3bb7a3ebefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:50:20.368659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be3a42-d0cc-4332-a5bd-e3bb7a3ebefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:50:20.370073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be3a42-d0cc-4332-a5bd-e3bb7a3ebefa service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:50:20.379250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 781/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:50:30.024503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=11 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:50:30.375242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:49.590335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9daab-890c-4c81-a632-9888b6bf5fb6 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.591827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9daab-890c-4c81-a632-9888b6bf5fb6 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.591827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9daab-890c-4c81-a632-9888b6bf5fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.593031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9ca6-31f5-47c2-8ac9-ad4366dca281 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.593501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9ca6-31f5-47c2-8ac9-ad4366dca281 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.593593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9ca6-31f5-47c2-8ac9-ad4366dca281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.618544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c6a9daab-890c-4c81-a632-9888b6bf5fb6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.630272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c6a9daab-890c-4c81-a632-9888b6bf5fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.631600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f3ed9ca6-31f5-47c2-8ac9-ad4366dca281 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.632828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f3ed9ca6-31f5-47c2-8ac9-ad4366dca281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.645519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 759/1540] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:49.652296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 782/1541] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:51:49.667144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aad92a-e17b-4c99-a01b-95864603d3a7 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.667470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aad92a-e17b-4c99-a01b-95864603d3a7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.667692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413229e-0d3f-455d-bbe6-9b65038fbcc0 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.667820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aad92a-e17b-4c99-a01b-95864603d3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.667978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413229e-0d3f-455d-bbe6-9b65038fbcc0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.668248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413229e-0d3f-455d-bbe6-9b65038fbcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.704217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b413229e-0d3f-455d-bbe6-9b65038fbcc0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.705439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b413229e-0d3f-455d-bbe6-9b65038fbcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.708871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c7aad92a-e17b-4c99-a01b-95864603d3a7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.710079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c7aad92a-e17b-4c99-a01b-95864603d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.726225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 783/1542] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:51:49.726998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 760/1543] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:51:49.727542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107542f2-4e6f-44e3-89cb-d63cc9599790 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.727827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107542f2-4e6f-44e3-89cb-d63cc9599790 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.728101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107542f2-4e6f-44e3-89cb-d63cc9599790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.735997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aad92a-e17b-4c99-a01b-95864603d3a7 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:49.752594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aad92a-e17b-4c99-a01b-95864603d3a7 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:49.763965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-107542f2-4e6f-44e3-89cb-d63cc9599790 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.765174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-107542f2-4e6f-44e3-89cb-d63cc9599790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.765303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f404d1c-049d-4d86-9c1d-14385cdca14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:49.765844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f404d1c-049d-4d86-9c1d-14385cdca14e admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.766131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f404d1c-049d-4d86-9c1d-14385cdca14e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.766406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f404d1c-049d-4d86-9c1d-14385cdca14e admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.767148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f404d1c-049d-4d86-9c1d-14385cdca14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:51:49.767461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f404d1c-049d-4d86-9c1d-14385cdca14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:49.769080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f404d1c-049d-4d86-9c1d-14385cdca14e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:49.781867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 784/1544] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:49.782713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107542f2-4e6f-44e3-89cb-d63cc9599790 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:49.789893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 761/1545] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:51:49.795458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daade5d-7b83-4e6f-b7fc-df2a89574632 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.795749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daade5d-7b83-4e6f-b7fc-df2a89574632 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.796029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daade5d-7b83-4e6f-b7fc-df2a89574632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.805775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107542f2-4e6f-44e3-89cb-d63cc9599790 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:49.814361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3a5d9-a2eb-4238-b3c4-b83a9e3147c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:49.815028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3a5d9-a2eb-4238-b3c4-b83a9e3147c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.815311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3a5d9-a2eb-4238-b3c4-b83a9e3147c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.815584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3a5d9-a2eb-4238-b3c4-b83a9e3147c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.816288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3a5d9-a2eb-4238-b3c4-b83a9e3147c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:51:49.816596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3a5d9-a2eb-4238-b3c4-b83a9e3147c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:49.817628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING py.warnings [None req-9fd3a5d9-a2eb-4238-b3c4-b83a9e3147c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:51:49.817628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: warnings.warn(msg) Jul 26 07:51:49.817628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: Jul 26 07:51:49.818517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3a5d9-a2eb-4238-b3c4-b83a9e3147c4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:49.823851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9daade5d-7b83-4e6f-b7fc-df2a89574632 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.825755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9daade5d-7b83-4e6f-b7fc-df2a89574632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.832600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 785/1546] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:51:49.834058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48eea-b39b-4416-a9fd-18eea6a8296f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.834349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48eea-b39b-4416-a9fd-18eea6a8296f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.834779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48eea-b39b-4416-a9fd-18eea6a8296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.836583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 762/1547] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:49.849217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82670-be9f-4bc6-a393-c36e26fcfae1 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.849594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82670-be9f-4bc6-a393-c36e26fcfae1 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.849973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82670-be9f-4bc6-a393-c36e26fcfae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.863899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-28f48eea-b39b-4416-a9fd-18eea6a8296f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.865113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-28f48eea-b39b-4416-a9fd-18eea6a8296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.870465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ada82670-be9f-4bc6-a393-c36e26fcfae1 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.871782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ada82670-be9f-4bc6-a393-c36e26fcfae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.873719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 786/1548] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:49.874967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96054-d3e4-4a2b-a89e-66d6b99c7c6b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.875223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96054-d3e4-4a2b-a89e-66d6b99c7c6b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.875502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96054-d3e4-4a2b-a89e-66d6b99c7c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.883242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 763/1549] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:49.883242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82670-be9f-4bc6-a393-c36e26fcfae1 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:49.892717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82670-be9f-4bc6-a393-c36e26fcfae1 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:49.897281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab823d72-e98e-4bdb-8e90-b76dd9ed6356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:49.897879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823d72-e98e-4bdb-8e90-b76dd9ed6356 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.898160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823d72-e98e-4bdb-8e90-b76dd9ed6356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.898431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823d72-e98e-4bdb-8e90-b76dd9ed6356 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.899104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-aee96054-d3e4-4a2b-a89e-66d6b99c7c6b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.899237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab823d72-e98e-4bdb-8e90-b76dd9ed6356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:49.900126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING py.warnings [None req-ab823d72-e98e-4bdb-8e90-b76dd9ed6356 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:51:49.900126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: warnings.warn(msg) Jul 26 07:51:49.900126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: Jul 26 07:51:49.900393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-aee96054-d3e4-4a2b-a89e-66d6b99c7c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.901353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab823d72-e98e-4bdb-8e90-b76dd9ed6356 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:49.908440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 787/1550] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:49.909629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8ed45-cd99-4733-8a73-d8a9821dfa77 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.909923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8ed45-cd99-4733-8a73-d8a9821dfa77 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.910196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8ed45-cd99-4733-8a73-d8a9821dfa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.933055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-02f8ed45-cd99-4733-8a73-d8a9821dfa77 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.934261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-02f8ed45-cd99-4733-8a73-d8a9821dfa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:49.938805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 764/1551] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:49.940086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c129-e52d-4345-9af7-78297d508d99 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:49.940373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c129-e52d-4345-9af7-78297d508d99 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:49.940650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c129-e52d-4345-9af7-78297d508d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:49.945780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 788/1552] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:49.946613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8ed45-cd99-4733-8a73-d8a9821dfa77 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:49.957412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8ed45-cd99-4733-8a73-d8a9821dfa77 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:49.960218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ca82c129-e52d-4345-9af7-78297d508d99 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:49.961493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ca82c129-e52d-4345-9af7-78297d508d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:50.014561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519102d-c5e5-4147-8cb7-ec1e7d40ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.015212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519102d-c5e5-4147-8cb7-ec1e7d40ba6e admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.015495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519102d-c5e5-4147-8cb7-ec1e7d40ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.015772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519102d-c5e5-4147-8cb7-ec1e7d40ba6e admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.016434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519102d-c5e5-4147-8cb7-ec1e7d40ba6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.018359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519102d-c5e5-4147-8cb7-ec1e7d40ba6e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.023627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 765/1553] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:50.025032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705b350-68a3-4ab8-8bc7-725ff8d59b07 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.025326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705b350-68a3-4ab8-8bc7-725ff8d59b07 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.026135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705b350-68a3-4ab8-8bc7-725ff8d59b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.046059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a705b350-68a3-4ab8-8bc7-725ff8d59b07 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:50.047302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a705b350-68a3-4ab8-8bc7-725ff8d59b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:50.050737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 789/1554] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:49 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.052194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08ed5-4a74-4767-a76a-74483c5e2be2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.052489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08ed5-4a74-4767-a76a-74483c5e2be2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.052772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08ed5-4a74-4767-a76a-74483c5e2be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.058727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 766/1555] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:50.059380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705b350-68a3-4ab8-8bc7-725ff8d59b07 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.070056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705b350-68a3-4ab8-8bc7-725ff8d59b07 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.072316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-daf08ed5-4a74-4767-a76a-74483c5e2be2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:50.073635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-daf08ed5-4a74-4767-a76a-74483c5e2be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:50.132363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.132987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.133268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.133549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.134240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:51:50.134548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.136265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.138682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 790/1556] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:50.139990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6205e-8b2b-42bb-8015-5464ca90ecb4 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.140278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6205e-8b2b-42bb-8015-5464ca90ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.140557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6205e-8b2b-42bb-8015-5464ca90ecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.148610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 767/1557] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:51:50.149795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.160772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293efa7-573c-4247-9662-e134d79690ca admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.160972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-05f6205e-8b2b-42bb-8015-5464ca90ecb4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:50.162023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-05f6205e-8b2b-42bb-8015-5464ca90ecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:50.165420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca028b-1e0f-4bee-854e-798937ed6d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.166023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca028b-1e0f-4bee-854e-798937ed6d12 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.166854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca028b-1e0f-4bee-854e-798937ed6d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.167170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca028b-1e0f-4bee-854e-798937ed6d12 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.167879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca028b-1e0f-4bee-854e-798937ed6d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.169763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca028b-1e0f-4bee-854e-798937ed6d12 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.170492 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 791/1558] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:50.171297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6205e-8b2b-42bb-8015-5464ca90ecb4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.180609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6205e-8b2b-42bb-8015-5464ca90ecb4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.185545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.186049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:50.186191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.186429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.186708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.187437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:51:50.187884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.189547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.192749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 768/1559] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.193810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72375-00ea-4b21-a1b6-353fa15089b0 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.194100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72375-00ea-4b21-a1b6-353fa15089b0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.194518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72375-00ea-4b21-a1b6-353fa15089b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.204596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 792/1560] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:51:50.204596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.212431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9f8cf-eb2f-4dc1-9ac1-af91256c41df admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.217690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.218231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-6df72375-00ea-4b21-a1b6-353fa15089b0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:50.218387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.218563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.218847 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.219538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6df72375-00ea-4b21-a1b6-353fa15089b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:50.219656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.220554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING py.warnings [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:51:50.220554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: warnings.warn(msg) Jul 26 07:51:50.220554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: Jul 26 07:51:50.221762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.227521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 769/1561] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:50.229283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1e39-d88f-43a4-ad43-5a6d4203b5c5 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.229584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1e39-d88f-43a4-ad43-5a6d4203b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.229865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1e39-d88f-43a4-ad43-5a6d4203b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.233832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:50.245790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 793/1562] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.246453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.254673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f62b1e39-d88f-43a4-ad43-5a6d4203b5c5 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:50.255928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f62b1e39-d88f-43a4-ad43-5a6d4203b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:50.256062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d3db-79c7-42ed-8333-d8221a69dcb0 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.260486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.261082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.261363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.261639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.262324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:51:50.262659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.267927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 770/1563] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:50.268274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.268390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1e39-d88f-43a4-ad43-5a6d4203b5c5 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.275090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1e39-d88f-43a4-ad43-5a6d4203b5c5 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.284900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 794/1564] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:51:50.284900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.285176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889a9ff-108b-4d5f-a3ff-1cd88041a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.285176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889a9ff-108b-4d5f-a3ff-1cd88041a41e admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.285176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889a9ff-108b-4d5f-a3ff-1cd88041a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.285176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889a9ff-108b-4d5f-a3ff-1cd88041a41e admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.285518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889a9ff-108b-4d5f-a3ff-1cd88041a41e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.287554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889a9ff-108b-4d5f-a3ff-1cd88041a41e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.288277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96191e78-56ec-4e2b-8639-dc4d9a87071f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.292904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.293502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.293791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.294086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.294781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:51:50.295122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.296721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.309467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 795/1565] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:51:50.310378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.319829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf86cc-bf82-4d0e-b39a-331413393716 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.323877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 771/1566] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.323877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889a9ff-108b-4d5f-a3ff-1cd88041a41e admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.378549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fed3b-ffae-4950-b5a6-82821af83a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.379127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fed3b-ffae-4950-b5a6-82821af83a7b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.379410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fed3b-ffae-4950-b5a6-82821af83a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.379683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fed3b-ffae-4950-b5a6-82821af83a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.380372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fed3b-ffae-4950-b5a6-82821af83a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.382111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fed3b-ffae-4950-b5a6-82821af83a7b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.384591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889a9ff-108b-4d5f-a3ff-1cd88041a41e admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.389644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daaf9c-e1df-491b-a9e1-e7281f48d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.390337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daaf9c-e1df-491b-a9e1-e7281f48d7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.390693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daaf9c-e1df-491b-a9e1-e7281f48d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.391072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daaf9c-e1df-491b-a9e1-e7281f48d7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.391782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33daaf9c-e1df-491b-a9e1-e7281f48d7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.392051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 796/1567] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:50.392836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fed3b-ffae-4950-b5a6-82821af83a7b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.396806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33daaf9c-e1df-491b-a9e1-e7281f48d7c3 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.402156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fed3b-ffae-4950-b5a6-82821af83a7b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.406676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.407289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.407569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.407844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.408523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:51:50.408826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.410378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.422883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 797/1568] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:51:50.423708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.432544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 772/1569] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.433252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daaf9c-e1df-491b-a9e1-e7281f48d7c3 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.433602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600cac5-ac1d-4a2f-ad2f-2144ff7f6eb3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.493225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dd794-92fe-4d14-a8f2-4cef242fdc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.493853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd794-92fe-4d14-a8f2-4cef242fdc46 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.495083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd794-92fe-4d14-a8f2-4cef242fdc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.495083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd794-92fe-4d14-a8f2-4cef242fdc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.495781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dd794-92fe-4d14-a8f2-4cef242fdc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.497437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dd794-92fe-4d14-a8f2-4cef242fdc46 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.498335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daaf9c-e1df-491b-a9e1-e7281f48d7c3 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.502901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.503539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.503820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.504093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.504784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:51:50.505116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.506698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.510738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 798/1570] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:50.510738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dd794-92fe-4d14-a8f2-4cef242fdc46 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.518062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dd794-92fe-4d14-a8f2-4cef242fdc46 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.523460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 773/1571] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:51:50.523460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.524400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b791637-059e-4433-84c5-0cc07199a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.524999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791637-059e-4433-84c5-0cc07199a68c admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.525290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791637-059e-4433-84c5-0cc07199a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.525601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791637-059e-4433-84c5-0cc07199a68c admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.526226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b791637-059e-4433-84c5-0cc07199a68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.528154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b791637-059e-4433-84c5-0cc07199a68c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.533021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1757992-2802-474d-9245-227b4ac2d35c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.537510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f9e44-b71b-4b92-9ee6-a55f4ed4ad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.538294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f9e44-b71b-4b92-9ee6-a55f4ed4ad55 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.538391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f9e44-b71b-4b92-9ee6-a55f4ed4ad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.539003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f9e44-b71b-4b92-9ee6-a55f4ed4ad55 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.539333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f9e44-b71b-4b92-9ee6-a55f4ed4ad55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.541773 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f9e44-b71b-4b92-9ee6-a55f4ed4ad55 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.557689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 799/1572] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.558950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b791637-059e-4433-84c5-0cc07199a68c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.573016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 774/1573] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.573859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f9e44-b71b-4b92-9ee6-a55f4ed4ad55 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.594025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:50.598773 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:50.630292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b791637-059e-4433-84c5-0cc07199a68c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.635090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b18a5-144d-47f2-9c88-bd00066580f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.635721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b18a5-144d-47f2-9c88-bd00066580f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.636002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b18a5-144d-47f2-9c88-bd00066580f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.636279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b18a5-144d-47f2-9c88-bd00066580f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.636945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b18a5-144d-47f2-9c88-bd00066580f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.638058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f9e44-b71b-4b92-9ee6-a55f4ed4ad55 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.639160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b18a5-144d-47f2-9c88-bd00066580f7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.642787 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4765e0-f4d9-4c27-979d-30738aa5af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.643508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4765e0-f4d9-4c27-979d-30738aa5af41 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.643792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4765e0-f4d9-4c27-979d-30738aa5af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.644065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4765e0-f4d9-4c27-979d-30738aa5af41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.644761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4765e0-f4d9-4c27-979d-30738aa5af41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.646341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4765e0-f4d9-4c27-979d-30738aa5af41 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.661096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 775/1574] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:50.661096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4765e0-f4d9-4c27-979d-30738aa5af41 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.661394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 800/1575] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.661970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b18a5-144d-47f2-9c88-bd00066580f7 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.667742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4765e0-f4d9-4c27-979d-30738aa5af41 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.672377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abf0ff-9ae1-4fd2-bc85-8c0f610c6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.673011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abf0ff-9ae1-4fd2-bc85-8c0f610c6d70 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.673291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abf0ff-9ae1-4fd2-bc85-8c0f610c6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.673562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abf0ff-9ae1-4fd2-bc85-8c0f610c6d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.674221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abf0ff-9ae1-4fd2-bc85-8c0f610c6d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.674919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b18a5-144d-47f2-9c88-bd00066580f7 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.676151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abf0ff-9ae1-4fd2-bc85-8c0f610c6d70 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.679554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902dcd-e9d4-42f2-82a2-3cd8acd1f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.680294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902dcd-e9d4-42f2-82a2-3cd8acd1f33d admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.680586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902dcd-e9d4-42f2-82a2-3cd8acd1f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.680864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902dcd-e9d4-42f2-82a2-3cd8acd1f33d admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.681568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01902dcd-e9d4-42f2-82a2-3cd8acd1f33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.684044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01902dcd-e9d4-42f2-82a2-3cd8acd1f33d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.704627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 776/1576] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.708038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 801/1577] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.708179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abf0ff-9ae1-4fd2-bc85-8c0f610c6d70 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.708308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902dcd-e9d4-42f2-82a2-3cd8acd1f33d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.717847 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902dcd-e9d4-42f2-82a2-3cd8acd1f33d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.769012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abf0ff-9ae1-4fd2-bc85-8c0f610c6d70 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.773605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f400db-f13f-45d5-a1e0-e2c57122c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.774223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f400db-f13f-45d5-a1e0-e2c57122c898 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.774361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85fe75-6c71-4f9d-b394-5d33f3fba178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.774488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f400db-f13f-45d5-a1e0-e2c57122c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.774764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f400db-f13f-45d5-a1e0-e2c57122c898 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.774858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85fe75-6c71-4f9d-b394-5d33f3fba178 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.775176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85fe75-6c71-4f9d-b394-5d33f3fba178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.775982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85fe75-6c71-4f9d-b394-5d33f3fba178 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.776087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f400db-f13f-45d5-a1e0-e2c57122c898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.776655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85fe75-6c71-4f9d-b394-5d33f3fba178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.777591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f400db-f13f-45d5-a1e0-e2c57122c898 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.778904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85fe75-6c71-4f9d-b394-5d33f3fba178 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.787652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 777/1578] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:50.788453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f400db-f13f-45d5-a1e0-e2c57122c898 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.798614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f400db-f13f-45d5-a1e0-e2c57122c898 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.803433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7b203-2e54-4024-bf2a-719835bedf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.804034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7b203-2e54-4024-bf2a-719835bedf85 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.804319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7b203-2e54-4024-bf2a-719835bedf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.804600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7b203-2e54-4024-bf2a-719835bedf85 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.805258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7b203-2e54-4024-bf2a-719835bedf85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.807297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7b203-2e54-4024-bf2a-719835bedf85 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.809647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 802/1579] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.810605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85fe75-6c71-4f9d-b394-5d33f3fba178 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.831610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 778/1580] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.831610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7b203-2e54-4024-bf2a-719835bedf85 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.842363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7b203-2e54-4024-bf2a-719835bedf85 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.874550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85fe75-6c71-4f9d-b394-5d33f3fba178 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.879534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b2d8-8e6d-410c-ae6d-40c0a9e9dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.880261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b2d8-8e6d-410c-ae6d-40c0a9e9dc05 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.880703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b2d8-8e6d-410c-ae6d-40c0a9e9dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.881033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b2d8-8e6d-410c-ae6d-40c0a9e9dc05 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.881865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1b2d8-8e6d-410c-ae6d-40c0a9e9dc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.883967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1b2d8-8e6d-410c-ae6d-40c0a9e9dc05 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.899945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.901136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.901427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.901683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] PATH_INFO: `/v3/projects/1b8b3351fbf14d3385d0287f41c23025/users/c42352a47bf04dadaa592a4b18fc2340/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.908528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 803/1581] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:50.908528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b2d8-8e6d-410c-ae6d-40c0a9e9dc05 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.916103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8b3351fbf14d3385d0287f41c23025, user_id=c42352a47bf04dadaa592a4b18fc2340, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.917643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING py.warnings [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:51:50.917643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: warnings.warn(msg) Jul 26 07:51:50.917643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: Jul 26 07:51:50.918913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b2d8-8e6d-410c-ae6d-40c0a9e9dc05 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:50.919593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.923980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab1feb-f1a0-45f2-a785-c693c810426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:50.924760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab1feb-f1a0-45f2-a785-c693c810426b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:50.925151 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab1feb-f1a0-45f2-a785-c693c810426b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:50.925542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab1feb-f1a0-45f2-a785-c693c810426b admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:50.926295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab1feb-f1a0-45f2-a785-c693c810426b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:50.927643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:50.928028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab1feb-f1a0-45f2-a785-c693c810426b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:50.933263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 779/1582] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:50 2022] PUT /identity/v3/projects/1b8b3351fbf14d3385d0287f41c23025/users/c42352a47bf04dadaa592a4b18fc2340/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:50.936219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.941517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 804/1583] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:50.941517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab1feb-f1a0-45f2-a785-c693c810426b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:50.946381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:50.952691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab1feb-f1a0-45f2-a785-c693c810426b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.001756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ec913-6871-4e80-b536-11bb80d3043f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.006582 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302b45c-6e93-40d3-8165-9363ced0dfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.007238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b45c-6e93-40d3-8165-9363ced0dfad admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.007524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b45c-6e93-40d3-8165-9363ced0dfad admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.007805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302b45c-6e93-40d3-8165-9363ced0dfad admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.008469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302b45c-6e93-40d3-8165-9363ced0dfad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.009966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd1c2-1cd0-4a8f-b09f-aa84a0c3926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.010458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302b45c-6e93-40d3-8165-9363ced0dfad admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.010572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd1c2-1cd0-4a8f-b09f-aa84a0c3926b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.010858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd1c2-1cd0-4a8f-b09f-aa84a0c3926b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.011171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd1c2-1cd0-4a8f-b09f-aa84a0c3926b admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.011865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dd1c2-1cd0-4a8f-b09f-aa84a0c3926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.013715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dd1c2-1cd0-4a8f-b09f-aa84a0c3926b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.023481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 805/1584] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.024343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd1c2-1cd0-4a8f-b09f-aa84a0c3926b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.032379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 780/1585] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:50 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:51.033255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302b45c-6e93-40d3-8165-9363ced0dfad admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.037345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd1c2-1cd0-4a8f-b09f-aa84a0c3926b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.042629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff2f3c-07a4-4970-aa88-61c0bf3ea8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.043355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff2f3c-07a4-4970-aa88-61c0bf3ea8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.043485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302b45c-6e93-40d3-8165-9363ced0dfad admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.043638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff2f3c-07a4-4970-aa88-61c0bf3ea8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.043913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff2f3c-07a4-4970-aa88-61c0bf3ea8b2 admin admin] PATH_INFO: `/v3/projects/689fd1e7c85043b5b46df3dca883b9e9/users/19beebc60ea348c0b09cdb926218ce6f/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.048090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399a73b-9553-4e09-bf7b-976a49b85807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.048702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399a73b-9553-4e09-bf7b-976a49b85807 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.048974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399a73b-9553-4e09-bf7b-976a49b85807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.049254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399a73b-9553-4e09-bf7b-976a49b85807 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.049920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399a73b-9553-4e09-bf7b-976a49b85807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.051867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399a73b-9553-4e09-bf7b-976a49b85807 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.058448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff2f3c-07a4-4970-aa88-61c0bf3ea8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689fd1e7c85043b5b46df3dca883b9e9, user_id=19beebc60ea348c0b09cdb926218ce6f, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.061120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff2f3c-07a4-4970-aa88-61c0bf3ea8b2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.075687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 781/1586] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:51 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:51.076545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399a73b-9553-4e09-bf7b-976a49b85807 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.078823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 806/1587] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:51 2022] PUT /identity/v3/projects/689fd1e7c85043b5b46df3dca883b9e9/users/19beebc60ea348c0b09cdb926218ce6f/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:51.079833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff2f3c-07a4-4970-aa88-61c0bf3ea8b2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.089384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399a73b-9553-4e09-bf7b-976a49b85807 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.144064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff2f3c-07a4-4970-aa88-61c0bf3ea8b2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.146229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0f431-6d25-4d1c-a21e-a1b82a237430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.146950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0f431-6d25-4d1c-a21e-a1b82a237430 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.147235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0f431-6d25-4d1c-a21e-a1b82a237430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.147508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0f431-6d25-4d1c-a21e-a1b82a237430 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.148209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0f431-6d25-4d1c-a21e-a1b82a237430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.149009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4314d24-615d-4cb5-8aea-eaf7f21d217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.149634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314d24-615d-4cb5-8aea-eaf7f21d217c admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.149795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0f431-6d25-4d1c-a21e-a1b82a237430 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.149912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314d24-615d-4cb5-8aea-eaf7f21d217c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.150217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314d24-615d-4cb5-8aea-eaf7f21d217c admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.151544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314d24-615d-4cb5-8aea-eaf7f21d217c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.153156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314d24-615d-4cb5-8aea-eaf7f21d217c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.160442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 782/1588] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.161650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022237ae-a474-40f6-bba1-7c6c7ab0aeeb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.161954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022237ae-a474-40f6-bba1-7c6c7ab0aeeb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.162215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022237ae-a474-40f6-bba1-7c6c7ab0aeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.163392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 807/1589] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.166832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4314d24-615d-4cb5-8aea-eaf7f21d217c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.176420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4314d24-615d-4cb5-8aea-eaf7f21d217c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.180746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-022237ae-a474-40f6-bba1-7c6c7ab0aeeb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:51.181541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b4c5c-443f-414a-98ca-21930aaf61c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.182061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-022237ae-a474-40f6-bba1-7c6c7ab0aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:51.182226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4c5c-443f-414a-98ca-21930aaf61c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.182516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4c5c-443f-414a-98ca-21930aaf61c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.182794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4c5c-443f-414a-98ca-21930aaf61c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.183535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b4c5c-443f-414a-98ca-21930aaf61c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.185166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b4c5c-443f-414a-98ca-21930aaf61c7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.189804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 783/1590] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:51.192371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022237ae-a474-40f6-bba1-7c6c7ab0aeeb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.200148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 808/1591] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.200148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b4c5c-443f-414a-98ca-21930aaf61c7 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.203925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022237ae-a474-40f6-bba1-7c6c7ab0aeeb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.208698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf971bf-8000-4303-aa2d-5049447f72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.209306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf971bf-8000-4303-aa2d-5049447f72ef admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.209591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf971bf-8000-4303-aa2d-5049447f72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.209700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b4c5c-443f-414a-98ca-21930aaf61c7 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.209864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf971bf-8000-4303-aa2d-5049447f72ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.210561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf971bf-8000-4303-aa2d-5049447f72ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.212178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf971bf-8000-4303-aa2d-5049447f72ef admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.215105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661dd49e-dc6d-45d9-99a4-11772d0b85ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.215907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dd49e-dc6d-45d9-99a4-11772d0b85ff admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.216352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dd49e-dc6d-45d9-99a4-11772d0b85ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.216651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dd49e-dc6d-45d9-99a4-11772d0b85ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.217327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661dd49e-dc6d-45d9-99a4-11772d0b85ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.219098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661dd49e-dc6d-45d9-99a4-11772d0b85ff admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.222824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 784/1592] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.223655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf971bf-8000-4303-aa2d-5049447f72ef admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.231799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 809/1593] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.232832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf971bf-8000-4303-aa2d-5049447f72ef admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.233069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f02e8-ee07-44c5-982a-398880128450 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.233365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f02e8-ee07-44c5-982a-398880128450 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.234640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f02e8-ee07-44c5-982a-398880128450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.237524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8444-d758-4aa2-84b0-2c40b7de49f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.238122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8444-d758-4aa2-84b0-2c40b7de49f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.238400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8444-d758-4aa2-84b0-2c40b7de49f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.238675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8444-d758-4aa2-84b0-2c40b7de49f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.239388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c8444-d758-4aa2-84b0-2c40b7de49f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.240955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c8444-d758-4aa2-84b0-2c40b7de49f5 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.250999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 785/1594] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.251788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8444-d758-4aa2-84b0-2c40b7de49f5 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.254609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-eb9f02e8-ee07-44c5-982a-398880128450 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:51.255865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-eb9f02e8-ee07-44c5-982a-398880128450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:51.263631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8444-d758-4aa2-84b0-2c40b7de49f5 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.265064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 810/1595] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:51.265894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f02e8-ee07-44c5-982a-398880128450 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.271756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af532e9-2039-4f4e-abf4-80b7b4a02d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.272364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af532e9-2039-4f4e-abf4-80b7b4a02d46 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.272647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af532e9-2039-4f4e-abf4-80b7b4a02d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.272924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af532e9-2039-4f4e-abf4-80b7b4a02d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.273618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af532e9-2039-4f4e-abf4-80b7b4a02d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.276086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af532e9-2039-4f4e-abf4-80b7b4a02d46 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.276579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f02e8-ee07-44c5-982a-398880128450 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.281616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1d1e4-3b65-4a9c-9053-fe9cc7aecd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.282227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1d1e4-3b65-4a9c-9053-fe9cc7aecd63 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.282508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1d1e4-3b65-4a9c-9053-fe9cc7aecd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.282779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1d1e4-3b65-4a9c-9053-fe9cc7aecd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.283501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1d1e4-3b65-4a9c-9053-fe9cc7aecd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.285267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1d1e4-3b65-4a9c-9053-fe9cc7aecd63 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.286750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 786/1596] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.287570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af532e9-2039-4f4e-abf4-80b7b4a02d46 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.296524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 811/1597] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.297593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1d1e4-3b65-4a9c-9053-fe9cc7aecd63 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.307573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1d1e4-3b65-4a9c-9053-fe9cc7aecd63 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.312264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5057f-b58f-47c3-a482-d46e37ff3dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.312915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5057f-b58f-47c3-a482-d46e37ff3dec admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.313208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5057f-b58f-47c3-a482-d46e37ff3dec admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.313495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5057f-b58f-47c3-a482-d46e37ff3dec admin admin] PATH_INFO: `/v3/projects/638ac666404e4359b66ff15874b6431c/users/563ad296ba724b54a9e87b9298084140/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.319505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:51.330306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5057f-b58f-47c3-a482-d46e37ff3dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=638ac666404e4359b66ff15874b6431c, user_id=563ad296ba724b54a9e87b9298084140, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.332987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5057f-b58f-47c3-a482-d46e37ff3dec admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.347032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 812/1598] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:51 2022] PUT /identity/v3/projects/638ac666404e4359b66ff15874b6431c/users/563ad296ba724b54a9e87b9298084140/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:51.350640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5057f-b58f-47c3-a482-d46e37ff3dec admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.351973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af532e9-2039-4f4e-abf4-80b7b4a02d46 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.356294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:51.401161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c7c7-5c8d-4ae1-95b4-e02c4290a014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.401783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c7c7-5c8d-4ae1-95b4-e02c4290a014 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.402062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c7c7-5c8d-4ae1-95b4-e02c4290a014 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.402332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c7c7-5c8d-4ae1-95b4-e02c4290a014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.410616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5057f-b58f-47c3-a482-d46e37ff3dec admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.411466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c7c7-5c8d-4ae1-95b4-e02c4290a014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.412887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c7c7-5c8d-4ae1-95b4-e02c4290a014 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.415263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d26c6-1c2e-4d52-a7cc-a8836483e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.415928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d26c6-1c2e-4d52-a7cc-a8836483e2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.416239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d26c6-1c2e-4d52-a7cc-a8836483e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.416519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d26c6-1c2e-4d52-a7cc-a8836483e2ee admin admin] PATH_INFO: `/v3/projects/a34edb14f04144619e2fcac7f2b8d8aa/users/0db0b77cc6ef4b8aa20d0304ec99e5e8/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.422612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 787/1599] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:51:51.423494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c7c7-5c8d-4ae1-95b4-e02c4290a014 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.431335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d26c6-1c2e-4d52-a7cc-a8836483e2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34edb14f04144619e2fcac7f2b8d8aa, user_id=0db0b77cc6ef4b8aa20d0304ec99e5e8, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.432696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c7c7-5c8d-4ae1-95b4-e02c4290a014 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.434215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d26c6-1c2e-4d52-a7cc-a8836483e2ee admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.438502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.438756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.439092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.439363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.440026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.441609 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.450569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 813/1600] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:51 2022] PUT /identity/v3/projects/a34edb14f04144619e2fcac7f2b8d8aa/users/0db0b77cc6ef4b8aa20d0304ec99e5e8/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:51.451179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d26c6-1c2e-4d52-a7cc-a8836483e2ee admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.460558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 788/1601] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.461328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.463671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:51.475941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40137493-4ad7-4f9b-a5d8-1320e327d54e admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.527436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d26c6-1c2e-4d52-a7cc-a8836483e2ee admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.532144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a2521-8be5-4b09-994a-1f67dfd5c5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.532292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216777f-3b9e-4c36-a073-ce7e45addd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.532830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216777f-3b9e-4c36-a073-ce7e45addd6b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.533003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a2521-8be5-4b09-994a-1f67dfd5c5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.533116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216777f-3b9e-4c36-a073-ce7e45addd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.533508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216777f-3b9e-4c36-a073-ce7e45addd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.533620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a2521-8be5-4b09-994a-1f67dfd5c5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.533899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a2521-8be5-4b09-994a-1f67dfd5c5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.534212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216777f-3b9e-4c36-a073-ce7e45addd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.535862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216777f-3b9e-4c36-a073-ce7e45addd6b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.547839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a2521-8be5-4b09-994a-1f67dfd5c5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.549843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a2521-8be5-4b09-994a-1f67dfd5c5f8 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.560573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 814/1602] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:51.560573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216777f-3b9e-4c36-a073-ce7e45addd6b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.565216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 789/1603] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:51:51.566459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a2521-8be5-4b09-994a-1f67dfd5c5f8 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.569302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216777f-3b9e-4c36-a073-ce7e45addd6b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.574782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7839-b158-4d79-9c3b-ca22d6e9a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.575590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7839-b158-4d79-9c3b-ca22d6e9a4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.576089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7839-b158-4d79-9c3b-ca22d6e9a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.576234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7839-b158-4d79-9c3b-ca22d6e9a4cd admin admin] PATH_INFO: `/v3/projects/bbcc54c3b9464961b6d0f2f5969e0d99/users/3b0d14280a8c449b8cbc4a021a0638b7/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.580475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a2521-8be5-4b09-994a-1f67dfd5c5f8 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.585633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f15ca0-029b-4f62-9b04-1d080079ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.586551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f15ca0-029b-4f62-9b04-1d080079ebf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.587082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f15ca0-029b-4f62-9b04-1d080079ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.587421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f15ca0-029b-4f62-9b04-1d080079ebf2 admin admin] PATH_INFO: `/v3/projects/edd63e4d52054e8984ae925e991270cb/users/63f3f5bddc8b4aa58a34e10d60aeb0ea/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.592049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a7839-b158-4d79-9c3b-ca22d6e9a4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcc54c3b9464961b6d0f2f5969e0d99, user_id=3b0d14280a8c449b8cbc4a021a0638b7, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.594903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a7839-b158-4d79-9c3b-ca22d6e9a4cd admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.611225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f15ca0-029b-4f62-9b04-1d080079ebf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd63e4d52054e8984ae925e991270cb, user_id=63f3f5bddc8b4aa58a34e10d60aeb0ea, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.613518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 815/1604] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:51 2022] PUT /identity/v3/projects/bbcc54c3b9464961b6d0f2f5969e0d99/users/3b0d14280a8c449b8cbc4a021a0638b7/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:51.614711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f15ca0-029b-4f62-9b04-1d080079ebf2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.621395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10730-32c9-426c-8324-52441e7a90fd None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.622674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10730-32c9-426c-8324-52441e7a90fd None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.622977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10730-32c9-426c-8324-52441e7a90fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.647357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5dd10730-32c9-426c-8324-52441e7a90fd None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:51.648843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5dd10730-32c9-426c-8324-52441e7a90fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:51.663000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 790/1605] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:51 2022] PUT /identity/v3/projects/edd63e4d52054e8984ae925e991270cb/users/63f3f5bddc8b4aa58a34e10d60aeb0ea/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:51.663000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40387d4-32d8-4b97-a018-2fb817704c60 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.663000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40387d4-32d8-4b97-a018-2fb817704c60 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.663000 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40387d4-32d8-4b97-a018-2fb817704c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.688942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a40387d4-32d8-4b97-a018-2fb817704c60 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:51.690275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a40387d4-32d8-4b97-a018-2fb817704c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:51.718968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 816/1606] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:51.722312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd10730-32c9-426c-8324-52441e7a90fd None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.725051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:51.732230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd10730-32c9-426c-8324-52441e7a90fd None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.738711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af8676-a997-42d6-a08e-86f359b62b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.739516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8676-a997-42d6-a08e-86f359b62b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.739802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8676-a997-42d6-a08e-86f359b62b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.740378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8676-a997-42d6-a08e-86f359b62b80 admin admin] PATH_INFO: `/v3/projects/782d8228cf8d4caaa5b3820a1868df53/users/760d5fbf0ff648a1805f0351168429e9/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.755116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:51.758392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af8676-a997-42d6-a08e-86f359b62b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782d8228cf8d4caaa5b3820a1868df53, user_id=760d5fbf0ff648a1805f0351168429e9, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.762073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af8676-a997-42d6-a08e-86f359b62b80 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.782535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 791/1607] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:51.783969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40387d4-32d8-4b97-a018-2fb817704c60 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:51.788401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 817/1608] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:51 2022] PUT /identity/v3/projects/782d8228cf8d4caaa5b3820a1868df53/users/760d5fbf0ff648a1805f0351168429e9/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:51.790330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ef1f0-f9a1-45b0-9d68-b50d39a3b32f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.790550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ef1f0-f9a1-45b0-9d68-b50d39a3b32f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.790952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ef1f0-f9a1-45b0-9d68-b50d39a3b32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.798101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40387d4-32d8-4b97-a018-2fb817704c60 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:51.825893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-817ef1f0-f9a1-45b0-9d68-b50d39a3b32f None None] MFA Rules not processed for user `3b0d14280a8c449b8cbc4a021a0638b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:51.827378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-817ef1f0-f9a1-45b0-9d68-b50d39a3b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:51.912640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c52b-163a-4164-899e-e2ae017029e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:51.913397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c52b-163a-4164-899e-e2ae017029e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.913681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c52b-163a-4164-899e-e2ae017029e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.914012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c52b-163a-4164-899e-e2ae017029e3 admin admin] PATH_INFO: `/v3/projects/cdfe813271734e90870b900ea33daa3e/users/c1eb6c09b2c9426c9137d761f7417c88/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.946044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c52b-163a-4164-899e-e2ae017029e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfe813271734e90870b900ea33daa3e, user_id=c1eb6c09b2c9426c9137d761f7417c88, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:51.949350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c52b-163a-4164-899e-e2ae017029e3 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:51.950075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 818/1609] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:51.951809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac2d5-6091-4f8f-bf20-84f56c5bf5f9 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:51.952452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac2d5-6091-4f8f-bf20-84f56c5bf5f9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:51.952845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac2d5-6091-4f8f-bf20-84f56c5bf5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:51.989182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 792/1610] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:51 2022] PUT /identity/v3/projects/cdfe813271734e90870b900ea33daa3e/users/c1eb6c09b2c9426c9137d761f7417c88/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:51.990140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c52b-163a-4164-899e-e2ae017029e3 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.003789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-78aac2d5-6091-4f8f-bf20-84f56c5bf5f9 None None] MFA Rules not processed for user `63f3f5bddc8b4aa58a34e10d60aeb0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:52.007955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-78aac2d5-6091-4f8f-bf20-84f56c5bf5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:52.098406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c52b-163a-4164-899e-e2ae017029e3 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.104236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d3a7-9c22-4c2e-86eb-e1405a414b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.105596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d3a7-9c22-4c2e-86eb-e1405a414b61 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.106286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d3a7-9c22-4c2e-86eb-e1405a414b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.107155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d3a7-9c22-4c2e-86eb-e1405a414b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.121685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 819/1611] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:52.123305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b0a9-6fd0-4783-af51-15e6823320f1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.123901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b0a9-6fd0-4783-af51-15e6823320f1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.124686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b0a9-6fd0-4783-af51-15e6823320f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.155701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-aa11b0a9-6fd0-4783-af51-15e6823320f1 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:52.157524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-aa11b0a9-6fd0-4783-af51-15e6823320f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:52.199233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d3a7-9c22-4c2e-86eb-e1405a414b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:52.201217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d3a7-9c22-4c2e-86eb-e1405a414b61 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:52.212519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:52.215992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 793/1612] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:51:52.217734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d3a7-9c22-4c2e-86eb-e1405a414b61 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.227320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 820/1613] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:52.227320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de331-ae2a-46ed-94dc-c24d62d22338 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.227320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de331-ae2a-46ed-94dc-c24d62d22338 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.227320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de331-ae2a-46ed-94dc-c24d62d22338 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.228128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d3a7-9c22-4c2e-86eb-e1405a414b61 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.229509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 821/1614] 10.222.0.46 () {54 vars in 962 bytes} [Tue Jul 26 07:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:51:52.230657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355d22-b0e5-4b7b-aa17-0db5a68a51e9 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.231039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355d22-b0e5-4b7b-aa17-0db5a68a51e9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.231968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355d22-b0e5-4b7b-aa17-0db5a68a51e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.237286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9ec6-2979-4b57-adb8-afa83c2fb513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.237926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9ec6-2979-4b57-adb8-afa83c2fb513 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.238215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9ec6-2979-4b57-adb8-afa83c2fb513 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.238496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9ec6-2979-4b57-adb8-afa83c2fb513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.250142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a9ec6-2979-4b57-adb8-afa83c2fb513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:52.251557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a9ec6-2979-4b57-adb8-afa83c2fb513 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:52.263726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-03355d22-b0e5-4b7b-aa17-0db5a68a51e9 None None] MFA Rules not processed for user `c1eb6c09b2c9426c9137d761f7417c88`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:52.264652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 794/1615] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:51:52.265297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-03355d22-b0e5-4b7b-aa17-0db5a68a51e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:52.265701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9ec6-2979-4b57-adb8-afa83c2fb513 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.285494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:52.355097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9ec6-2979-4b57-adb8-afa83c2fb513 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.363568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd94c-6e01-4089-8ff3-5255f47375c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.364764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd94c-6e01-4089-8ff3-5255f47375c9 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.365271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd94c-6e01-4089-8ff3-5255f47375c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.365842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd94c-6e01-4089-8ff3-5255f47375c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.366853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 822/1616] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:52.368253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330811af-23f2-480f-9ab3-1d044aecd9d2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.368648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330811af-23f2-480f-9ab3-1d044aecd9d2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.368930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330811af-23f2-480f-9ab3-1d044aecd9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.379504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdd94c-6e01-4089-8ff3-5255f47375c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:52.381875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdd94c-6e01-4089-8ff3-5255f47375c9 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:52.394905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 795/1617] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:51:52.396196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd94c-6e01-4089-8ff3-5255f47375c9 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.409634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd94c-6e01-4089-8ff3-5255f47375c9 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.415360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae0d01-e8d9-4814-bba3-9bc10d675015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.417132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae0d01-e8d9-4814-bba3-9bc10d675015 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.417866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae0d01-e8d9-4814-bba3-9bc10d675015 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.418430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae0d01-e8d9-4814-bba3-9bc10d675015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.432575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae0d01-e8d9-4814-bba3-9bc10d675015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:52.439755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae0d01-e8d9-4814-bba3-9bc10d675015 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:52.455529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-330811af-23f2-480f-9ab3-1d044aecd9d2 None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:52.457104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 796/1618] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:51:52.457998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae0d01-e8d9-4814-bba3-9bc10d675015 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.458668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-330811af-23f2-480f-9ab3-1d044aecd9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:52.474370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae0d01-e8d9-4814-bba3-9bc10d675015 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.482541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a879a8-941d-4ce2-9d00-e72571e10221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.483265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a879a8-941d-4ce2-9d00-e72571e10221 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.483560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a879a8-941d-4ce2-9d00-e72571e10221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.483981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a879a8-941d-4ce2-9d00-e72571e10221 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.486619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a879a8-941d-4ce2-9d00-e72571e10221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:52.490464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a879a8-941d-4ce2-9d00-e72571e10221 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:52.552132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 797/1619] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:52 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:52.555819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a879a8-941d-4ce2-9d00-e72571e10221 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.640641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 823/1620] 10.222.0.46 () {58 vars in 1059 bytes} [Tue Jul 26 07:51:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:52.652283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330811af-23f2-480f-9ab3-1d044aecd9d2 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.675613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330811af-23f2-480f-9ab3-1d044aecd9d2 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.719430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a879a8-941d-4ce2-9d00-e72571e10221 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.733502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94ccd8-f8d1-424a-bcfc-38d5a5fbc7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.734154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ccd8-f8d1-424a-bcfc-38d5a5fbc7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.734443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ccd8-f8d1-424a-bcfc-38d5a5fbc7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.734789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94ccd8-f8d1-424a-bcfc-38d5a5fbc7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.735527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94ccd8-f8d1-424a-bcfc-38d5a5fbc7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:52.737493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94ccd8-f8d1-424a-bcfc-38d5a5fbc7e9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:52.786220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 798/1621] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:52 2022] POST /identity/v3/users => generated 295 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:52.791045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94ccd8-f8d1-424a-bcfc-38d5a5fbc7e9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.814217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94ccd8-f8d1-424a-bcfc-38d5a5fbc7e9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.817223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:52.828736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654983a-3953-48af-9843-eeb125942eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.832066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654983a-3953-48af-9843-eeb125942eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.832449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654983a-3953-48af-9843-eeb125942eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.832807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654983a-3953-48af-9843-eeb125942eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.833960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654983a-3953-48af-9843-eeb125942eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:52.836698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0484-21fb-4611-b5de-25dd8e5625f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.839352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0484-21fb-4611-b5de-25dd8e5625f6 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.839708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0484-21fb-4611-b5de-25dd8e5625f6 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.840349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654983a-3953-48af-9843-eeb125942eb1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:52.840715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0484-21fb-4611-b5de-25dd8e5625f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.857297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 799/1622] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:51:52.862099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654983a-3953-48af-9843-eeb125942eb1 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:52.886599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654983a-3953-48af-9843-eeb125942eb1 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:52.902385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ff3ca-d25f-4d8f-909e-8e9fa72a0b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:52.903145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ff3ca-d25f-4d8f-909e-8e9fa72a0b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:52.903434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ff3ca-d25f-4d8f-909e-8e9fa72a0b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:52.903718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ff3ca-d25f-4d8f-909e-8e9fa72a0b81 admin admin] PATH_INFO: `/v3/projects/d00824e67ba5453196ed19f25c5ab3c9/users/13007e316c5648a8b8bda6287be41ed7/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:52.962546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ff3ca-d25f-4d8f-909e-8e9fa72a0b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00824e67ba5453196ed19f25c5ab3c9, user_id=13007e316c5648a8b8bda6287be41ed7, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:52.979807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ff3ca-d25f-4d8f-909e-8e9fa72a0b81 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:53.004388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b0484-21fb-4611-b5de-25dd8e5625f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:53.006716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b0484-21fb-4611-b5de-25dd8e5625f6 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:53.024775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 800/1623] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:52 2022] PUT /identity/v3/projects/d00824e67ba5453196ed19f25c5ab3c9/users/13007e316c5648a8b8bda6287be41ed7/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:53.026099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ff3ca-d25f-4d8f-909e-8e9fa72a0b81 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:53.048693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 824/1624] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:51:53.099792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:53.153424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ff3ca-d25f-4d8f-909e-8e9fa72a0b81 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:53.165584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e9488-f229-40e9-96e4-42f797295c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:53.166357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9488-f229-40e9-96e4-42f797295c19 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:53.166651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9488-f229-40e9-96e4-42f797295c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:53.166957 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e9488-f229-40e9-96e4-42f797295c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:53.167687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e9488-f229-40e9-96e4-42f797295c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:53.169555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e9488-f229-40e9-96e4-42f797295c19 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:53.194977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 801/1625] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:53.200032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0484-21fb-4611-b5de-25dd8e5625f6 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:53.219238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0484-21fb-4611-b5de-25dd8e5625f6 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:53.227620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86268af-c421-492b-a360-5bef7048a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:53.228317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86268af-c421-492b-a360-5bef7048a396 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:53.228643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86268af-c421-492b-a360-5bef7048a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:53.228925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86268af-c421-492b-a360-5bef7048a396 admin admin] PATH_INFO: `/v3/projects/d00824e67ba5453196ed19f25c5ab3c9/users/13007e316c5648a8b8bda6287be41ed7/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:53.235500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86268af-c421-492b-a360-5bef7048a396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00824e67ba5453196ed19f25c5ab3c9, user_id=13007e316c5648a8b8bda6287be41ed7, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:53.238164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86268af-c421-492b-a360-5bef7048a396 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:53.263239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 825/1626] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:53 2022] PUT /identity/v3/projects/d00824e67ba5453196ed19f25c5ab3c9/users/13007e316c5648a8b8bda6287be41ed7/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:53.273125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1402-a228-4a54-83c5-db883368eca0 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:53.273806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1402-a228-4a54-83c5-db883368eca0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:53.274116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba1402-a228-4a54-83c5-db883368eca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:53.355552 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8cba1402-a228-4a54-83c5-db883368eca0 None None] MFA Rules not processed for user `13007e316c5648a8b8bda6287be41ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:53.356810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8cba1402-a228-4a54-83c5-db883368eca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:53.504249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb0a2-dc44-46ff-9f15-b7f4b2867da6 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:53.504563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb0a2-dc44-46ff-9f15-b7f4b2867da6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:53.504844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb0a2-dc44-46ff-9f15-b7f4b2867da6 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:53.506331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 826/1627] 10.222.0.46 () {54 vars in 912 bytes} [Tue Jul 26 07:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:51:53.516624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e6b17-c341-403b-ba23-ae981c29da5c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:53.516912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e6b17-c341-403b-ba23-ae981c29da5c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:53.517192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e6b17-c341-403b-ba23-ae981c29da5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:53.522163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 802/1628] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:53.534859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba1402-a228-4a54-83c5-db883368eca0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:53.568312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3e3e6b17-c341-403b-ba23-ae981c29da5c None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:53.569842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3e3e6b17-c341-403b-ba23-ae981c29da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:53.665050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba1402-a228-4a54-83c5-db883368eca0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:53.675506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48590f9e-6458-4746-b739-068b07d1145e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:53.676427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48590f9e-6458-4746-b739-068b07d1145e service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:53.676900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48590f9e-6458-4746-b739-068b07d1145e service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:53.677368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48590f9e-6458-4746-b739-068b07d1145e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:53.731838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 827/1629] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:51:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:51:53.740346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e6b17-c341-403b-ba23-ae981c29da5c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:53.753011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e6b17-c341-403b-ba23-ae981c29da5c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:53.768018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a995-7cb7-4a15-916a-04fb7de85d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:53.768817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a995-7cb7-4a15-916a-04fb7de85d86 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:53.769203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a995-7cb7-4a15-916a-04fb7de85d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:53.769932 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a995-7cb7-4a15-916a-04fb7de85d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:53.785983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a995-7cb7-4a15-916a-04fb7de85d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:53.788216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48590f9e-6458-4746-b739-068b07d1145e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:53.789752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a995-7cb7-4a15-916a-04fb7de85d86 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:53.790395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48590f9e-6458-4746-b739-068b07d1145e service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:53.808828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 803/1630] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:51:53.827679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 828/1631] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:51:55.163478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc27e39-b2eb-4f5a-9afb-f7fea6607681 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.163996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc27e39-b2eb-4f5a-9afb-f7fea6607681 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.164134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc27e39-b2eb-4f5a-9afb-f7fea6607681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.197804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a730c5-b82a-4123-8e32-12883dd20d0e None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.198382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a730c5-b82a-4123-8e32-12883dd20d0e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.198588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a730c5-b82a-4123-8e32-12883dd20d0e None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.200056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 829/1632] 10.222.0.46 () {54 vars in 962 bytes} [Tue Jul 26 07:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:51:55.208177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:55.210432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416c84-5a32-4587-b031-770fe314b6a0 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.212025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416c84-5a32-4587-b031-770fe314b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.213631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62416c84-5a32-4587-b031-770fe314b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.227996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0dc27e39-b2eb-4f5a-9afb-f7fea6607681 None None] MFA Rules not processed for user `563ad296ba724b54a9e87b9298084140`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:55.232223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0dc27e39-b2eb-4f5a-9afb-f7fea6607681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:55.252521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-62416c84-5a32-4587-b031-770fe314b6a0 None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:55.256555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-62416c84-5a32-4587-b031-770fe314b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:55.278073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 830/1633] 10.222.0.46 () {58 vars in 1059 bytes} [Tue Jul 26 07:51:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:55.286837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f5f50-e445-4d1f-85ea-d79a99df10ee None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.288363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f5f50-e445-4d1f-85ea-d79a99df10ee None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.288889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f5f50-e445-4d1f-85ea-d79a99df10ee None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.295412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 831/1634] 10.222.0.46 () {54 vars in 912 bytes} [Tue Jul 26 07:51:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:51:55.301140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4534d-5851-42be-846f-fd5d6fb5a34b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.301878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4534d-5851-42be-846f-fd5d6fb5a34b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.302528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4534d-5851-42be-846f-fd5d6fb5a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.355062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-dfc4534d-5851-42be-846f-fd5d6fb5a34b None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:55.360348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dfc4534d-5851-42be-846f-fd5d6fb5a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:55.382298 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 832/1635] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:51:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:55.394897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 804/1636] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:51:55.398696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4534d-5851-42be-846f-fd5d6fb5a34b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:55.406767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc27e39-b2eb-4f5a-9afb-f7fea6607681 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:55.453450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc27e39-b2eb-4f5a-9afb-f7fea6607681 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:55.462323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a6b2e-361a-4e72-b9df-d09adf0db55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:55.463210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6b2e-361a-4e72-b9df-d09adf0db55a service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.463494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6b2e-361a-4e72-b9df-d09adf0db55a service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.463767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a6b2e-361a-4e72-b9df-d09adf0db55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.488969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a6b2e-361a-4e72-b9df-d09adf0db55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:55.492140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a6b2e-361a-4e72-b9df-d09adf0db55a service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:55.517969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 805/1637] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:51:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:51:55.518197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:51:55.525944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4534d-5851-42be-846f-fd5d6fb5a34b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:55.537013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260657-6af7-4e4c-aeee-00234d3dda39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:55.537947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260657-6af7-4e4c-aeee-00234d3dda39 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.538383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260657-6af7-4e4c-aeee-00234d3dda39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.538810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260657-6af7-4e4c-aeee-00234d3dda39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.539674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260657-6af7-4e4c-aeee-00234d3dda39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:55.541836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260657-6af7-4e4c-aeee-00234d3dda39 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:55.592385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a6b2e-361a-4e72-b9df-d09adf0db55a service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:55.599327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 833/1638] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:51:55 2022] POST /identity/v3/projects => generated 405 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:55.620432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a6b2e-361a-4e72-b9df-d09adf0db55a service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:55.780584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931aac-7c7e-4b20-85a8-f612a9d547ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:55.781229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931aac-7c7e-4b20-85a8-f612a9d547ad admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.781513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931aac-7c7e-4b20-85a8-f612a9d547ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.781830 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931aac-7c7e-4b20-85a8-f612a9d547ad admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.782954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38931aac-7c7e-4b20-85a8-f612a9d547ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:55.793197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38931aac-7c7e-4b20-85a8-f612a9d547ad admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:55.847092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 806/1639] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:51:55 2022] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:51:55.850712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260657-6af7-4e4c-aeee-00234d3dda39 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:55.866619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260657-6af7-4e4c-aeee-00234d3dda39 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:55.907909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ba5c-0b0c-40f8-b4f6-ce230ed05b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:55.908556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ba5c-0b0c-40f8-b4f6-ce230ed05b05 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.908836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ba5c-0b0c-40f8-b4f6-ce230ed05b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.909121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ba5c-0b0c-40f8-b4f6-ce230ed05b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:55.909822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ba5c-0b0c-40f8-b4f6-ce230ed05b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:55.911930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ba5c-0b0c-40f8-b4f6-ce230ed05b05 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:55.938190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931aac-7c7e-4b20-85a8-f612a9d547ad admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:55.939112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 834/1640] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:55.949533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931aac-7c7e-4b20-85a8-f612a9d547ad admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:55.963997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7dac8-223f-4eef-9868-69164f012cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:55.964702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7dac8-223f-4eef-9868-69164f012cac admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:55.964993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7dac8-223f-4eef-9868-69164f012cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:55.965586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7dac8-223f-4eef-9868-69164f012cac admin admin] PATH_INFO: `/v3/projects/8fbda39ace244feda078a2314d0b0fde/users/faea86d489244fb8b6e0b4d86b2d37d0/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:56.011729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7dac8-223f-4eef-9868-69164f012cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fbda39ace244feda078a2314d0b0fde, user_id=faea86d489244fb8b6e0b4d86b2d37d0, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:56.014735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7dac8-223f-4eef-9868-69164f012cac admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:56.045799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 807/1641] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:55 2022] PUT /identity/v3/projects/8fbda39ace244feda078a2314d0b0fde/users/faea86d489244fb8b6e0b4d86b2d37d0/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:56.047373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ba5c-0b0c-40f8-b4f6-ce230ed05b05 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:56.062531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ba5c-0b0c-40f8-b4f6-ce230ed05b05 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:56.181591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee63a5d-f304-46e9-b502-0724cb743413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:56.182240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee63a5d-f304-46e9-b502-0724cb743413 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:56.184319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee63a5d-f304-46e9-b502-0724cb743413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:56.184611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee63a5d-f304-46e9-b502-0724cb743413 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:56.186324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee63a5d-f304-46e9-b502-0724cb743413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:56.189987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee63a5d-f304-46e9-b502-0724cb743413 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:56.216804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7dac8-223f-4eef-9868-69164f012cac admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:51:56.227608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 835/1642] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:51:56.230132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7dac8-223f-4eef-9868-69164f012cac admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:51:56.243342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905a8cd-522c-473b-9eae-b3a3e67127ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:51:56.244410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905a8cd-522c-473b-9eae-b3a3e67127ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:56.246236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905a8cd-522c-473b-9eae-b3a3e67127ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:56.246716 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905a8cd-522c-473b-9eae-b3a3e67127ec admin admin] PATH_INFO: `/v3/projects/8fbda39ace244feda078a2314d0b0fde/users/faea86d489244fb8b6e0b4d86b2d37d0/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:56.250125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905a8cd-522c-473b-9eae-b3a3e67127ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fbda39ace244feda078a2314d0b0fde, user_id=faea86d489244fb8b6e0b4d86b2d37d0, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:51:56.263756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905a8cd-522c-473b-9eae-b3a3e67127ec admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:51:56.299979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 808/1643] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:51:56 2022] PUT /identity/v3/projects/8fbda39ace244feda078a2314d0b0fde/users/faea86d489244fb8b6e0b4d86b2d37d0/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:51:59.503365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114800-40aa-4e92-9367-645c0e6ea7e6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:51:59.503896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114800-40aa-4e92-9367-645c0e6ea7e6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:51:59.505068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114800-40aa-4e92-9367-645c0e6ea7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:51:59.578195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-26114800-40aa-4e92-9367-645c0e6ea7e6 None None] MFA Rules not processed for user `faea86d489244fb8b6e0b4d86b2d37d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:51:59.579602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-26114800-40aa-4e92-9367-645c0e6ea7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:51:59.753133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 836/1644] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:51:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:01.951034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52150fb5-272c-4004-b895-b25bd7588fda None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:01.952291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52150fb5-272c-4004-b895-b25bd7588fda None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:01.952767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52150fb5-272c-4004-b895-b25bd7588fda None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:01.954877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 809/1645] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:52:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:52:01.993834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ecbee-4b1a-438a-be89-1f0ceea7ef0f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:01.995305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ecbee-4b1a-438a-be89-1f0ceea7ef0f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:01.995782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ecbee-4b1a-438a-be89-1f0ceea7ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:02.039620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ce3ecbee-4b1a-438a-be89-1f0ceea7ef0f None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:02.042046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ce3ecbee-4b1a-438a-be89-1f0ceea7ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:02.148108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:02.217572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 837/1646] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:52:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:02.263468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52150fb5-272c-4004-b895-b25bd7588fda None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:02.340269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52150fb5-272c-4004-b895-b25bd7588fda None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:02.357413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d804f3b-bbbb-410f-bc43-6c71a845c92f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:02.358257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804f3b-bbbb-410f-bc43-6c71a845c92f service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:02.359678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ecbee-4b1a-438a-be89-1f0ceea7ef0f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:02.361342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804f3b-bbbb-410f-bc43-6c71a845c92f service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:02.365147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d804f3b-bbbb-410f-bc43-6c71a845c92f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:02.396845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d804f3b-bbbb-410f-bc43-6c71a845c92f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:02.399170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d804f3b-bbbb-410f-bc43-6c71a845c92f service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:02.427348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 810/1647] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:02.516175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ecbee-4b1a-438a-be89-1f0ceea7ef0f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:02.528449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a523a-8967-4a8f-afc4-d73ea7418d48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:02.529333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a523a-8967-4a8f-afc4-d73ea7418d48 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:02.529772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a523a-8967-4a8f-afc4-d73ea7418d48 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:02.530800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a523a-8967-4a8f-afc4-d73ea7418d48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:02.667566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a523a-8967-4a8f-afc4-d73ea7418d48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:02.671237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a523a-8967-4a8f-afc4-d73ea7418d48 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:02.697638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 838/1648] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:03.087274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d804f3b-bbbb-410f-bc43-6c71a845c92f service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:03.226112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:03.319459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d804f3b-bbbb-410f-bc43-6c71a845c92f service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:03.336054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:03.337656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:03.339131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:03.340290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] PATH_INFO: `/v3/users/3b0d14280a8c449b8cbc4a021a0638b7` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:03.343931 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0d14280a8c449b8cbc4a021a0638b7)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:03.345189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: WARNING py.warnings [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:52:03.345189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: warnings.warn(msg) Jul 26 07:52:03.345189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: Jul 26 07:52:03.350075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:03.553117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0d14280a8c449b8cbc4a021a0638b7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:03.598582 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0d14280a8c449b8cbc4a021a0638b7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:03.599404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0d14280a8c449b8cbc4a021a0638b7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:03.665638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0d14280a8c449b8cbc4a021a0638b7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:03.679600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0d14280a8c449b8cbc4a021a0638b7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:03.711259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 811/1649] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:03 2022] DELETE /identity/v3/users/3b0d14280a8c449b8cbc4a021a0638b7 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:03.717083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb03b2-58a5-45c2-84b6-e412ebb121f4 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:03.717634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb03b2-58a5-45c2-84b6-e412ebb121f4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:03.717721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb03b2-58a5-45c2-84b6-e412ebb121f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:03.759423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-89eb03b2-58a5-45c2-84b6-e412ebb121f4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:03.762077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-89eb03b2-58a5-45c2-84b6-e412ebb121f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:03.948301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 839/1650] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:03.964469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:03.968763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:04.156575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8cfc6-a785-460b-938e-f568280b681a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:04.176224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:04.176884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:04.177182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:04.177687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:04.205303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:04.210778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:04.235252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 812/1651] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:04.935529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2aea-c22b-4bfe-92ba-40b7ccc15078 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:04.936551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2aea-c22b-4bfe-92ba-40b7ccc15078 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:04.937009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2aea-c22b-4bfe-92ba-40b7ccc15078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:04.975488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-cdbc2aea-c22b-4bfe-92ba-40b7ccc15078 None None] MFA Rules not processed for user `c42352a47bf04dadaa592a4b18fc2340`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:04.976994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cdbc2aea-c22b-4bfe-92ba-40b7ccc15078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:05.009657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:05.064888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 840/1652] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:05.073094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:05.074874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:05.133632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:05.163605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99cb3-ead9-4c4d-abc7-b6999b0fcf04 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:05.173722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:05.174589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:05.175118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:05.175550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:05.217798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:05.223145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:05.262479 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 813/1653] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:05.422092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc2aea-c22b-4bfe-92ba-40b7ccc15078 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:05.425602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cdbc2aea-c22b-4bfe-92ba-40b7ccc15078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:05.469327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc2aea-c22b-4bfe-92ba-40b7ccc15078 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:05.486141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:05.487293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:05.487916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:05.488388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] PATH_INFO: `/v3/users/563ad296ba724b54a9e87b9298084140` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:05.492519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=563ad296ba724b54a9e87b9298084140)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:05.499861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:05.620700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563ad296ba724b54a9e87b9298084140'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:05.638476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563ad296ba724b54a9e87b9298084140'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:05.656807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563ad296ba724b54a9e87b9298084140'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:05.658394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563ad296ba724b54a9e87b9298084140'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:05.696411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563ad296ba724b54a9e87b9298084140'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:05.727441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 841/1654] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:05 2022] DELETE /identity/v3/users/563ad296ba724b54a9e87b9298084140 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:05.991372 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:05.992930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:06.037137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076b303-9007-4df7-9721-2ad351e86193 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:06.214819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:06.220797 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:06.221122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:06.221406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] PATH_INFO: `/v3/projects/bbcc54c3b9464961b6d0f2f5969e0d99` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:06.225099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcc54c3b9464961b6d0f2f5969e0d99)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:06.230857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:06.352699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcc54c3b9464961b6d0f2f5969e0d99', 'request_id': 'req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.401094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcc54c3b9464961b6d0f2f5969e0d99', 'request_id': 'req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.418885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:06.421684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcc54c3b9464961b6d0f2f5969e0d99', 'request_id': 'req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.422143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:06.444898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e0023-41c8-409c-9d58-9e81e34fbe8e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:06.462387 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] The token cache is being invalidate because project bbcc54c3b9464961b6d0f2f5969e0d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:06.463243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.468752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff9bb5f1-cec5-4b76-88d5-9631f75a94ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.478096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 814/1655] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:05 2022] DELETE /identity/v3/projects/bbcc54c3b9464961b6d0f2f5969e0d99 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:06.488075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b4fe-9582-43fe-93f1-422495a87e59 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:06.491459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b4fe-9582-43fe-93f1-422495a87e59 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:06.491887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b4fe-9582-43fe-93f1-422495a87e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:06.585578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-abc0b4fe-9582-43fe-93f1-422495a87e59 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:06.588170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-abc0b4fe-9582-43fe-93f1-422495a87e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:06.657094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:06.657777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:06.658270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:06.658692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] PATH_INFO: `/v3/projects/638ac666404e4359b66ff15874b6431c` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:06.665069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638ac666404e4359b66ff15874b6431c)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:06.666822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: WARNING py.warnings [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 07:52:06.666822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: warnings.warn(msg) Jul 26 07:52:06.666822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: Jul 26 07:52:06.669831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:06.776171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 815/1656] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:06.784644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3894c-ae4f-46ff-9825-4805c15facf6 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:06.785332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3894c-ae4f-46ff-9825-4805c15facf6 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:06.785623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3894c-ae4f-46ff-9825-4805c15facf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:06.803620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:06.838560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b7c3894c-ae4f-46ff-9825-4805c15facf6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:06.848745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:06.865750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b7c3894c-ae4f-46ff-9825-4805c15facf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:06.882481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638ac666404e4359b66ff15874b6431c', 'request_id': 'req-db3e8c45-c82f-4fd2-8716-37cbb77096d4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.904921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638ac666404e4359b66ff15874b6431c', 'request_id': 'req-db3e8c45-c82f-4fd2-8716-37cbb77096d4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.917299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638ac666404e4359b66ff15874b6431c', 'request_id': 'req-db3e8c45-c82f-4fd2-8716-37cbb77096d4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.957121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] The token cache is being invalidate because project 638ac666404e4359b66ff15874b6431c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:06.957326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.958040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-db3e8c45-c82f-4fd2-8716-37cbb77096d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:06.960112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 842/1657] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:06 2022] DELETE /identity/v3/projects/638ac666404e4359b66ff15874b6431c => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:06.961645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4526-17c1-423a-923c-c6fbf7a98cfb None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:06.961819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4526-17c1-423a-923c-c6fbf7a98cfb None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:06.962054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4526-17c1-423a-923c-c6fbf7a98cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:07.069464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-46cf4526-17c1-423a-923c-c6fbf7a98cfb None None] MFA Rules not processed for user `19beebc60ea348c0b09cdb926218ce6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:07.071247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 816/1658] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:07.071357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-46cf4526-17c1-423a-923c-c6fbf7a98cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:07.077381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3894c-ae4f-46ff-9825-4805c15facf6 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:07.081785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b7c3894c-ae4f-46ff-9825-4805c15facf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:07.112086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3894c-ae4f-46ff-9825-4805c15facf6 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:07.142184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:07.143086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:07.146285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:07.147351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] PATH_INFO: `/v3/users/faea86d489244fb8b6e0b4d86b2d37d0` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:07.152779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faea86d489244fb8b6e0b4d86b2d37d0)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:07.169852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:07.278354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 843/1659] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:07.279268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4526-17c1-423a-923c-c6fbf7a98cfb None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:07.304316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4526-17c1-423a-923c-c6fbf7a98cfb None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:07.317118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54cfd2-2cc9-4cdc-8670-bebd8399bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:07.317773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54cfd2-2cc9-4cdc-8670-bebd8399bb81 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:07.323712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54cfd2-2cc9-4cdc-8670-bebd8399bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:07.324155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54cfd2-2cc9-4cdc-8670-bebd8399bb81 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:07.324928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54cfd2-2cc9-4cdc-8670-bebd8399bb81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:07.325245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54cfd2-2cc9-4cdc-8670-bebd8399bb81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:07.326895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54cfd2-2cc9-4cdc-8670-bebd8399bb81 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:07.328604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faea86d489244fb8b6e0b4d86b2d37d0'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:07.339191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faea86d489244fb8b6e0b4d86b2d37d0'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:07.344085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faea86d489244fb8b6e0b4d86b2d37d0'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:07.365556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 844/1660] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:07.366891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc7e49-43c2-4966-8e49-de6e2cb89326 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:07.367280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc7e49-43c2-4966-8e49-de6e2cb89326 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:07.367560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc7e49-43c2-4966-8e49-de6e2cb89326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:07.369651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faea86d489244fb8b6e0b4d86b2d37d0'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:07.374699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faea86d489244fb8b6e0b4d86b2d37d0'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:07.402713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 817/1661] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:07 2022] DELETE /identity/v3/users/faea86d489244fb8b6e0b4d86b2d37d0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:07.404801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:07.407069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:07.465927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-46dc7e49-43c2-4966-8e49-de6e2cb89326 None None] MFA Rules not processed for user `760d5fbf0ff648a1805f0351168429e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:07.467261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-46dc7e49-43c2-4966-8e49-de6e2cb89326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:07.599977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3698f2b-a709-41f9-a931-37dc41d00c97 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:07.625423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd2b85-d306-48a2-a85b-2ff3f1103fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:07.626118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd2b85-d306-48a2-a85b-2ff3f1103fe2 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:07.626879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd2b85-d306-48a2-a85b-2ff3f1103fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:07.627883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd2b85-d306-48a2-a85b-2ff3f1103fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:07.634050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-80fd2b85-d306-48a2-a85b-2ff3f1103fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:07.667732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:07.674351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 845/1662] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:07.675397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc7e49-43c2-4966-8e49-de6e2cb89326 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:07.676889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-46dc7e49-43c2-4966-8e49-de6e2cb89326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:07.770182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:07.860318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc7e49-43c2-4966-8e49-de6e2cb89326 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:07.882527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd2b85-d306-48a2-a85b-2ff3f1103fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:07.883366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d092-d45c-49aa-85d4-7744da3b4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:07.884176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d092-d45c-49aa-85d4-7744da3b4822 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:07.885313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d092-d45c-49aa-85d4-7744da3b4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:07.889729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd2b85-d306-48a2-a85b-2ff3f1103fe2 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:07.892332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d092-d45c-49aa-85d4-7744da3b4822 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:07.893074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605d092-d45c-49aa-85d4-7744da3b4822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:07.895421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605d092-d45c-49aa-85d4-7744da3b4822 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:07.912808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 818/1663] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:07.934436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451a54-1641-4685-8708-bdc57027a719 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:07.934725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451a54-1641-4685-8708-bdc57027a719 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:07.935034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d451a54-1641-4685-8708-bdc57027a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:07.965552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 846/1664] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:07 2022] POST /identity/v3/projects => generated 405 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:07.969098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d092-d45c-49aa-85d4-7744da3b4822 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:08.008370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8d451a54-1641-4685-8708-bdc57027a719 None None] MFA Rules not processed for user `760d5fbf0ff648a1805f0351168429e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:08.009891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8d451a54-1641-4685-8708-bdc57027a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:08.165520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d092-d45c-49aa-85d4-7744da3b4822 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:08.176084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 819/1665] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:08.182766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d668eb-4ba9-4f29-88ec-644ee55442bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:08.186765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d668eb-4ba9-4f29-88ec-644ee55442bc admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:08.187880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d668eb-4ba9-4f29-88ec-644ee55442bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:08.188668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d668eb-4ba9-4f29-88ec-644ee55442bc admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:08.189814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d668eb-4ba9-4f29-88ec-644ee55442bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:08.191969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d668eb-4ba9-4f29-88ec-644ee55442bc admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:08.199897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d451a54-1641-4685-8708-bdc57027a719 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:08.210611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8d451a54-1641-4685-8708-bdc57027a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:08.242015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 847/1666] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:07 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:08.245823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d668eb-4ba9-4f29-88ec-644ee55442bc admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:08.272540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d668eb-4ba9-4f29-88ec-644ee55442bc admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:08.284741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:08.285524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:08.287514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:08.287514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:08.289157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:08.292611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:08.324948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 848/1667] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:08.326287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:08.331536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:08.389583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433422c-d449-4bf3-a01c-6de8d5e9f94b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:08.404023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:08.404845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:08.405385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:08.405612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] PATH_INFO: `/v3/projects/8fbda39ace244feda078a2314d0b0fde` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:08.408360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fbda39ace244feda078a2314d0b0fde)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:08.410745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:08.451276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d451a54-1641-4685-8708-bdc57027a719 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:08.467067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d83488-82e6-4e63-8548-74a7f4d12a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:08.470061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83488-82e6-4e63-8548-74a7f4d12a1b service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:08.471578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83488-82e6-4e63-8548-74a7f4d12a1b service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:08.471930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83488-82e6-4e63-8548-74a7f4d12a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:08.508938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d83488-82e6-4e63-8548-74a7f4d12a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:08.516517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d83488-82e6-4e63-8548-74a7f4d12a1b service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:08.576189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fbda39ace244feda078a2314d0b0fde', 'request_id': 'req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:08.589836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 820/1668] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:08.592565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d83488-82e6-4e63-8548-74a7f4d12a1b service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:08.629689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fbda39ace244feda078a2314d0b0fde', 'request_id': 'req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:08.664192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d83488-82e6-4e63-8548-74a7f4d12a1b service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:08.672027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fbda39ace244feda078a2314d0b0fde', 'request_id': 'req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:08.731139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] The token cache is being invalidate because project 8fbda39ace244feda078a2314d0b0fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:08.734435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:08.738046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ad1ad-6cfe-4c9f-b337-074b7a3f6489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:08.741831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 849/1669] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:08 2022] DELETE /identity/v3/projects/8fbda39ace244feda078a2314d0b0fde => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:08.743333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54e81-d1fe-41ec-ab94-145f84efbebc None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:08.746991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54e81-d1fe-41ec-ab94-145f84efbebc None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:08.747551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54e81-d1fe-41ec-ab94-145f84efbebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:08.793897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:08.851683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a9c54e81-d1fe-41ec-ab94-145f84efbebc None None] MFA Rules not processed for user `0db0b77cc6ef4b8aa20d0304ec99e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:08.854680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b0a2-135a-417a-aaba-b476e4887c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:08.855163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a9c54e81-d1fe-41ec-ab94-145f84efbebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:08.856707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b0a2-135a-417a-aaba-b476e4887c3d admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:08.858095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b0a2-135a-417a-aaba-b476e4887c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:08.860093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b0a2-135a-417a-aaba-b476e4887c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:08.861635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b0a2-135a-417a-aaba-b476e4887c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:08.865854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b0a2-135a-417a-aaba-b476e4887c3d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:08.880517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:08.889564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 821/1670] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:08.892262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61eeff-49b1-4eaf-a353-8fb08e24710f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:08.896527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61eeff-49b1-4eaf-a353-8fb08e24710f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:08.897369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61eeff-49b1-4eaf-a353-8fb08e24710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:08.954230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ba61eeff-49b1-4eaf-a353-8fb08e24710f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:08.956838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ba61eeff-49b1-4eaf-a353-8fb08e24710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:09.006131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 850/1671] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:09.017156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54e81-d1fe-41ec-ab94-145f84efbebc None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:09.017991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 822/1672] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:09.018922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a9c54e81-d1fe-41ec-ab94-145f84efbebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:09.021351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431ecd5-7cc4-43fe-96d9-8c966d50e03a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:09.021898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431ecd5-7cc4-43fe-96d9-8c966d50e03a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:09.023365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431ecd5-7cc4-43fe-96d9-8c966d50e03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:09.039917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54e81-d1fe-41ec-ab94-145f84efbebc None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:09.051551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:09.053611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:09.054071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:09.055105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] PATH_INFO: `/v3/projects/6f70c404a11f4584a140b0d852ee7832/users/d9bc7eefd3f047d587add8941356d98e/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:09.060389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1431ecd5-7cc4-43fe-96d9-8c966d50e03a None None] MFA Rules not processed for user `0db0b77cc6ef4b8aa20d0304ec99e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:09.063375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1431ecd5-7cc4-43fe-96d9-8c966d50e03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:09.092764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 823/1673] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:09.094208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b976f2-f9fd-4cd4-ab05-2b11a49762f3 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:09.094493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b976f2-f9fd-4cd4-ab05-2b11a49762f3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:09.094772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b976f2-f9fd-4cd4-ab05-2b11a49762f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:09.113038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f70c404a11f4584a140b0d852ee7832, user_id=d9bc7eefd3f047d587add8941356d98e, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:09.116371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:09.146960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 851/1674] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:09 2022] PUT /identity/v3/projects/6f70c404a11f4584a140b0d852ee7832/users/d9bc7eefd3f047d587add8941356d98e/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:09.146960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:09.147244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d7b976f2-f9fd-4cd4-ab05-2b11a49762f3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:09.147244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d7b976f2-f9fd-4cd4-ab05-2b11a49762f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:09.161329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:09.375505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9991d-8826-4b26-99be-b354198d0324 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:09.404056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fcb01-aabc-438b-b066-f5b8e6d35f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:09.404721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fcb01-aabc-438b-b066-f5b8e6d35f16 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:09.406150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fcb01-aabc-438b-b066-f5b8e6d35f16 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:09.406432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fcb01-aabc-438b-b066-f5b8e6d35f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:09.409647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 824/1675] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:09.413580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57aeb-a133-410c-8a2e-6ee49bcfb7fc None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:09.416300 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57aeb-a133-410c-8a2e-6ee49bcfb7fc None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:09.416585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57aeb-a133-410c-8a2e-6ee49bcfb7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:09.533067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-89b57aeb-a133-410c-8a2e-6ee49bcfb7fc None None] MFA Rules not processed for user `d9bc7eefd3f047d587add8941356d98e`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:09.536419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-89b57aeb-a133-410c-8a2e-6ee49bcfb7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:09.692642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fcb01-aabc-438b-b066-f5b8e6d35f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:09.700082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fcb01-aabc-438b-b066-f5b8e6d35f16 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:09.737862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 852/1676] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:09.746431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fcb01-aabc-438b-b066-f5b8e6d35f16 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:09.800122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fcb01-aabc-438b-b066-f5b8e6d35f16 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:09.821303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845d7d5-a6f4-4e70-96da-d4c1b1a4b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:09.835225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 825/1677] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:09.835512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d7d5-a6f4-4e70-96da-d4c1b1a4b75c admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:09.835512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d7d5-a6f4-4e70-96da-d4c1b1a4b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:09.835512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d7d5-a6f4-4e70-96da-d4c1b1a4b75c admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:09.835735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57aeb-a133-410c-8a2e-6ee49bcfb7fc None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:09.835838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845d7d5-a6f4-4e70-96da-d4c1b1a4b75c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:09.835838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845d7d5-a6f4-4e70-96da-d4c1b1a4b75c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:09.840339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845d7d5-a6f4-4e70-96da-d4c1b1a4b75c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:09.898394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57aeb-a133-410c-8a2e-6ee49bcfb7fc None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:09.916045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 853/1678] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:09.919802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656862b-e967-4191-8c1b-7d83bd0091ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:09.922902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656862b-e967-4191-8c1b-7d83bd0091ea admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:09.926183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235dc03-6972-47e7-b6e4-cf25aa4be48b None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:09.926655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656862b-e967-4191-8c1b-7d83bd0091ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:09.927105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656862b-e967-4191-8c1b-7d83bd0091ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:09.927874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235dc03-6972-47e7-b6e4-cf25aa4be48b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:09.928752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235dc03-6972-47e7-b6e4-cf25aa4be48b None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:09.929990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656862b-e967-4191-8c1b-7d83bd0091ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:09.934988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 854/1679] 10.222.0.46 () {54 vars in 912 bytes} [Tue Jul 26 07:52:09 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:52:09.936255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656862b-e967-4191-8c1b-7d83bd0091ea admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:09.939098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235dc03-6972-47e7-b6e4-cf25aa4be48b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:09.981817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235dc03-6972-47e7-b6e4-cf25aa4be48b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.004867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc2bb6-692a-4db7-9a3d-396cbc3d30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.005688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc2bb6-692a-4db7-9a3d-396cbc3d30fc admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.006108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc2bb6-692a-4db7-9a3d-396cbc3d30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.006517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc2bb6-692a-4db7-9a3d-396cbc3d30fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.010433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc2bb6-692a-4db7-9a3d-396cbc3d30fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.021318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc2bb6-692a-4db7-9a3d-396cbc3d30fc admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.037921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 826/1680] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:09 2022] POST /identity/v3/projects => generated 405 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:10.039492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848000-7af8-43c7-82e6-5538262df81f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.039947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848000-7af8-43c7-82e6-5538262df81f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.042960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848000-7af8-43c7-82e6-5538262df81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.059235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:10.110071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 855/1681] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:09 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:10.110071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc2bb6-692a-4db7-9a3d-396cbc3d30fc admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.145994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f2848000-7af8-43c7-82e6-5538262df81f None None] MFA Rules not processed for user `77a234b8e5f2472cb3e733f933ca1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:10.147249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f2848000-7af8-43c7-82e6-5538262df81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:10.182326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:10.269391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 827/1682] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:10.270252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2848000-7af8-43c7-82e6-5538262df81f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.298055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc2bb6-692a-4db7-9a3d-396cbc3d30fc admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.311849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0cc70-c7fc-4903-8b24-4dbc0e45d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.312512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0cc70-c7fc-4903-8b24-4dbc0e45d4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.312805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0cc70-c7fc-4903-8b24-4dbc0e45d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.313085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0cc70-c7fc-4903-8b24-4dbc0e45d4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.313770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0cc70-c7fc-4903-8b24-4dbc0e45d4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.315765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0cc70-c7fc-4903-8b24-4dbc0e45d4d2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.361877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 856/1683] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:10 2022] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:10.363484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081115-2da4-4bdc-8905-0cdd67937e88 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.363779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081115-2da4-4bdc-8905-0cdd67937e88 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.364059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081115-2da4-4bdc-8905-0cdd67937e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.408216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2848000-7af8-43c7-82e6-5538262df81f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.409460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-10081115-2da4-4bdc-8905-0cdd67937e88 None None] MFA Rules not processed for user `c42352a47bf04dadaa592a4b18fc2340`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:10.413300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-10081115-2da4-4bdc-8905-0cdd67937e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:10.416270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.416923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.417207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.417482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.418167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.423421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.494467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 828/1684] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:10 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:10.494467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.502348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:10.526620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c6929-e01e-4c4a-9788-f3f9e9354e79 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.534260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b95ef-5f67-49fc-85cf-5b503b3699f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.535842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b95ef-5f67-49fc-85cf-5b503b3699f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.535842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b95ef-5f67-49fc-85cf-5b503b3699f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.535842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b95ef-5f67-49fc-85cf-5b503b3699f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.558580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b95ef-5f67-49fc-85cf-5b503b3699f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.560074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b95ef-5f67-49fc-85cf-5b503b3699f6 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.575485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 829/1685] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:10.576233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 857/1686] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:10.576403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b95ef-5f67-49fc-85cf-5b503b3699f6 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.593230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10081115-2da4-4bdc-8905-0cdd67937e88 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.612455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b95ef-5f67-49fc-85cf-5b503b3699f6 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.635333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c470-3253-4a1a-a38f-926c34dd3a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.635985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c470-3253-4a1a-a38f-926c34dd3a84 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.636270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c470-3253-4a1a-a38f-926c34dd3a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.636543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c470-3253-4a1a-a38f-926c34dd3a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.637254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c470-3253-4a1a-a38f-926c34dd3a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.639462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c470-3253-4a1a-a38f-926c34dd3a84 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.640835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10081115-2da4-4bdc-8905-0cdd67937e88 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.655153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ee353-6cbd-43c4-9d7b-a1d01195ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.656029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee353-6cbd-43c4-9d7b-a1d01195ae23 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.656491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee353-6cbd-43c4-9d7b-a1d01195ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.656957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee353-6cbd-43c4-9d7b-a1d01195ae23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.657874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ee353-6cbd-43c4-9d7b-a1d01195ae23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.659728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ee353-6cbd-43c4-9d7b-a1d01195ae23 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.663660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 830/1687] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:10.664595 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c470-3253-4a1a-a38f-926c34dd3a84 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.688901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 858/1688] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:10.692570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ee353-6cbd-43c4-9d7b-a1d01195ae23 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.702799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c470-3253-4a1a-a38f-926c34dd3a84 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.718342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ee353-6cbd-43c4-9d7b-a1d01195ae23 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.718978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13da727-8daf-43c8-b297-54c5d2c48714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.719757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13da727-8daf-43c8-b297-54c5d2c48714 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.720102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13da727-8daf-43c8-b297-54c5d2c48714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.720382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13da727-8daf-43c8-b297-54c5d2c48714 admin admin] PATH_INFO: `/v3/projects/b25fcfdc29a14a138e55470cf6579d93/users/9423e518883c48faada4cd4ba5b0810c/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.733536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93d38-ef73-4b06-b761-d722d5830781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.737993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93d38-ef73-4b06-b761-d722d5830781 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.738260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93d38-ef73-4b06-b761-d722d5830781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.738538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93d38-ef73-4b06-b761-d722d5830781 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.739315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b93d38-ef73-4b06-b761-d722d5830781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.743513 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b93d38-ef73-4b06-b761-d722d5830781 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.754443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13da727-8daf-43c8-b297-54c5d2c48714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25fcfdc29a14a138e55470cf6579d93, user_id=9423e518883c48faada4cd4ba5b0810c, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.758013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13da727-8daf-43c8-b297-54c5d2c48714 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.776182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 859/1689] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:10.777341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93d38-ef73-4b06-b761-d722d5830781 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.800729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93d38-ef73-4b06-b761-d722d5830781 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.822653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 831/1690] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:10 2022] PUT /identity/v3/projects/b25fcfdc29a14a138e55470cf6579d93/users/9423e518883c48faada4cd4ba5b0810c/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:10.826528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13da727-8daf-43c8-b297-54c5d2c48714 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.942723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13da727-8daf-43c8-b297-54c5d2c48714 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:10.953164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c23f2-5d52-4c5a-ae78-d5fbbb4275e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.954231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c23f2-5d52-4c5a-ae78-d5fbbb4275e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.954656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c23f2-5d52-4c5a-ae78-d5fbbb4275e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.955164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c23f2-5d52-4c5a-ae78-d5fbbb4275e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.956808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c23f2-5d52-4c5a-ae78-d5fbbb4275e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:10.959857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c23f2-5d52-4c5a-ae78-d5fbbb4275e7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:10.961868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a52f0-207f-40f7-8a2b-a7a3ab8fe220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:10.963130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a52f0-207f-40f7-8a2b-a7a3ab8fe220 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.970698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a52f0-207f-40f7-8a2b-a7a3ab8fe220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.971334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a52f0-207f-40f7-8a2b-a7a3ab8fe220 admin admin] PATH_INFO: `/v3/projects/ba66b0d05f684551961d05d1da3f5c8d/users/94d697cbea85431e851b4b60a461d5de/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.974445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 832/1691] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:10.975970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987bdf-4034-4454-a082-26e688e6a683 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:10.976371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987bdf-4034-4454-a082-26e688e6a683 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:10.976803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987bdf-4034-4454-a082-26e688e6a683 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:10.979156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 833/1692] 10.222.0.46 () {54 vars in 912 bytes} [Tue Jul 26 07:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:52:10.982411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5987bdf-4034-4454-a082-26e688e6a683 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:10.993609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:11.018525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a52f0-207f-40f7-8a2b-a7a3ab8fe220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba66b0d05f684551961d05d1da3f5c8d, user_id=94d697cbea85431e851b4b60a461d5de, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:11.021669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a52f0-207f-40f7-8a2b-a7a3ab8fe220 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:11.029892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5987bdf-4034-4454-a082-26e688e6a683 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:11.042133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a3ea2-2fe6-43ac-a505-9370998bff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:11.043061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a3ea2-2fe6-43ac-a505-9370998bff6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.043458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a3ea2-2fe6-43ac-a505-9370998bff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.043870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a3ea2-2fe6-43ac-a505-9370998bff6b admin admin] PATH_INFO: `/v3/projects/b25fcfdc29a14a138e55470cf6579d93/users/9423e518883c48faada4cd4ba5b0810c/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.046531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a3ea2-2fe6-43ac-a505-9370998bff6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25fcfdc29a14a138e55470cf6579d93, user_id=9423e518883c48faada4cd4ba5b0810c, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:11.050371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a3ea2-2fe6-43ac-a505-9370998bff6b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:11.056024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:11.067622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 860/1693] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:10 2022] PUT /identity/v3/projects/ba66b0d05f684551961d05d1da3f5c8d/users/94d697cbea85431e851b4b60a461d5de/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:11.068872 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44660ec-cb15-4b81-8601-fe0a068e0d12 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.069118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 834/1694] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:10 2022] PUT /identity/v3/projects/b25fcfdc29a14a138e55470cf6579d93/users/9423e518883c48faada4cd4ba5b0810c/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:11.071340 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44660ec-cb15-4b81-8601-fe0a068e0d12 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.073919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44660ec-cb15-4b81-8601-fe0a068e0d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.080505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b77e-0ac5-4761-97bf-1c1ab450ee0e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.080857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b77e-0ac5-4761-97bf-1c1ab450ee0e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.081371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b77e-0ac5-4761-97bf-1c1ab450ee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.159675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ed79b77e-0ac5-4761-97bf-1c1ab450ee0e None None] MFA Rules not processed for user `94d697cbea85431e851b4b60a461d5de`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:11.160879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ed79b77e-0ac5-4761-97bf-1c1ab450ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:11.183731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c44660ec-cb15-4b81-8601-fe0a068e0d12 None None] MFA Rules not processed for user `77a234b8e5f2472cb3e733f933ca1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:11.185097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c44660ec-cb15-4b81-8601-fe0a068e0d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:11.294273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 861/1695] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:52:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:11.296419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4f70-5391-4ce1-96fd-cd8f095f2571 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.296874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4f70-5391-4ce1-96fd-cd8f095f2571 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.297159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4f70-5391-4ce1-96fd-cd8f095f2571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.342115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 835/1696] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:11.343547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79b77e-0ac5-4761-97bf-1c1ab450ee0e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:11.348097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ed79b77e-0ac5-4761-97bf-1c1ab450ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:11.359074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-d97b4f70-5391-4ce1-96fd-cd8f095f2571 None None] MFA Rules not processed for user `9423e518883c48faada4cd4ba5b0810c`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:11.360775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d97b4f70-5391-4ce1-96fd-cd8f095f2571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:11.363264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79b77e-0ac5-4761-97bf-1c1ab450ee0e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:11.377133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2391f14-4333-4cfc-b673-8e22811414fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:11.377708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2391f14-4333-4cfc-b673-8e22811414fb service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.378005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2391f14-4333-4cfc-b673-8e22811414fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.378284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2391f14-4333-4cfc-b673-8e22811414fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.395487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2391f14-4333-4cfc-b673-8e22811414fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:11.400941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2391f14-4333-4cfc-b673-8e22811414fb service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:11.422253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 836/1697] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:11.425558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2391f14-4333-4cfc-b673-8e22811414fb service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:11.574506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2391f14-4333-4cfc-b673-8e22811414fb service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:11.587130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 862/1698] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:11.590795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5d195-2b89-4e30-a728-85b2515a0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:11.591583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d195-2b89-4e30-a728-85b2515a0581 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.592396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d195-2b89-4e30-a728-85b2515a0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.592396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d195-2b89-4e30-a728-85b2515a0581 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.594994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5d195-2b89-4e30-a728-85b2515a0581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:11.596682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4f70-5391-4ce1-96fd-cd8f095f2571 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:11.599509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d97b4f70-5391-4ce1-96fd-cd8f095f2571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:11.611051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5d195-2b89-4e30-a728-85b2515a0581 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:11.702380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 837/1699] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:11 2022] POST /identity/v3/projects => generated 385 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:11.703707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5d195-2b89-4e30-a728-85b2515a0581 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:11.770985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4f70-5391-4ce1-96fd-cd8f095f2571 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:11.856958 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:11.864035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:11.871995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5d195-2b89-4e30-a728-85b2515a0581 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:11.886725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98aa2a-faaf-4c58-b846-cf91179a00f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:11.887421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98aa2a-faaf-4c58-b846-cf91179a00f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.887975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98aa2a-faaf-4c58-b846-cf91179a00f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.888162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabba53-7ef3-412e-b77a-d55390a6ca8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:11.888244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98aa2a-faaf-4c58-b846-cf91179a00f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.888897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabba53-7ef3-412e-b77a-d55390a6ca8e service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.888997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98aa2a-faaf-4c58-b846-cf91179a00f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:11.889309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabba53-7ef3-412e-b77a-d55390a6ca8e service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.889881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabba53-7ef3-412e-b77a-d55390a6ca8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.893842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98aa2a-faaf-4c58-b846-cf91179a00f5 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:11.948679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 838/1700] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:11 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:11.956723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98aa2a-faaf-4c58-b846-cf91179a00f5 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:11.978518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98aa2a-faaf-4c58-b846-cf91179a00f5 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:11.984402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabba53-7ef3-412e-b77a-d55390a6ca8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:11.986171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabba53-7ef3-412e-b77a-d55390a6ca8e service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:11.992346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849ffde-3196-4a69-92cf-e713acb48a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:11.993007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ffde-3196-4a69-92cf-e713acb48a35 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:11.993382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ffde-3196-4a69-92cf-e713acb48a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:11.993555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ffde-3196-4a69-92cf-e713acb48a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:11.994824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849ffde-3196-4a69-92cf-e713acb48a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:11.999325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849ffde-3196-4a69-92cf-e713acb48a35 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:12.000698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 863/1701] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:12.029982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 839/1702] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:12.032910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabba53-7ef3-412e-b77a-d55390a6ca8e service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:12.046659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e983b9-a4b1-44b1-801a-795660c95391 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:12.047089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e983b9-a4b1-44b1-801a-795660c95391 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:12.048733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e983b9-a4b1-44b1-801a-795660c95391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:12.090900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabba53-7ef3-412e-b77a-d55390a6ca8e service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:12.107594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cd562-efa8-4dc8-8564-5e982f19cd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:12.111619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd562-efa8-4dc8-8564-5e982f19cd25 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:12.113804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd562-efa8-4dc8-8564-5e982f19cd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:12.114561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd562-efa8-4dc8-8564-5e982f19cd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:12.116002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd562-efa8-4dc8-8564-5e982f19cd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:12.132092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-03e983b9-a4b1-44b1-801a-795660c95391 None None] MFA Rules not processed for user `19beebc60ea348c0b09cdb926218ce6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:12.141518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-03e983b9-a4b1-44b1-801a-795660c95391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:12.143681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd562-efa8-4dc8-8564-5e982f19cd25 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:12.201120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 864/1703] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:12.202112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cd562-efa8-4dc8-8564-5e982f19cd25 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:12.237728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cd562-efa8-4dc8-8564-5e982f19cd25 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:12.249199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ec044-35fb-4f9c-a8d4-fd3aa974c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:12.249973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ec044-35fb-4f9c-a8d4-fd3aa974c181 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:12.250470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ec044-35fb-4f9c-a8d4-fd3aa974c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:12.250702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ec044-35fb-4f9c-a8d4-fd3aa974c181 admin admin] PATH_INFO: `/v3/projects/d25c325fb9f44b9796fc351971489757/users/186419a69d4a4cd2afd742c2c63139c9/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:12.301086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ec044-35fb-4f9c-a8d4-fd3aa974c181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25c325fb9f44b9796fc351971489757, user_id=186419a69d4a4cd2afd742c2c63139c9, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:12.309741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ec044-35fb-4f9c-a8d4-fd3aa974c181 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:12.347315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 865/1704] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:12 2022] PUT /identity/v3/projects/d25c325fb9f44b9796fc351971489757/users/186419a69d4a4cd2afd742c2c63139c9/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:12.347501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 840/1705] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:12.352348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7b7d-7545-4d2a-bf67-def866303a4e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:12.352805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7b7d-7545-4d2a-bf67-def866303a4e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:12.353796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7b7d-7545-4d2a-bf67-def866303a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:12.371327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c5681-b920-4cd8-8fd7-bd986b6f2b72 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:12.372334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c5681-b920-4cd8-8fd7-bd986b6f2b72 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:12.372822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c5681-b920-4cd8-8fd7-bd986b6f2b72 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:12.377909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 841/1706] 10.222.0.46 () {54 vars in 961 bytes} [Tue Jul 26 07:52:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:52:12.382842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932aac-9dad-40dd-965e-8b80ee218c99 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:12.383467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932aac-9dad-40dd-965e-8b80ee218c99 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:12.383938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932aac-9dad-40dd-965e-8b80ee218c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:12.427686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-951d7b7d-7545-4d2a-bf67-def866303a4e None None] MFA Rules not processed for user `186419a69d4a4cd2afd742c2c63139c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:12.432478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-951d7b7d-7545-4d2a-bf67-def866303a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:12.441261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-eb932aac-9dad-40dd-965e-8b80ee218c99 None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:12.443095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-eb932aac-9dad-40dd-965e-8b80ee218c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:12.692290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 866/1707] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:12.694729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7b7d-7545-4d2a-bf67-def866303a4e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:12.698242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-951d7b7d-7545-4d2a-bf67-def866303a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:12.704695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 842/1708] 10.222.0.46 () {58 vars in 1058 bytes} [Tue Jul 26 07:52:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:12.707298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb932aac-9dad-40dd-965e-8b80ee218c99 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:12.734725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7b7d-7545-4d2a-bf67-def866303a4e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:12.753938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:12.764851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:12.765141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:12.765415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:12.778104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:12.828713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:12.839605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:12.886636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 867/1709] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:12.888377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:12.937400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a8808-4659-4dd7-8512-57674148cc27 service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:12.959948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26979403-e9fe-4a28-aa01-e57bf3a86249 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:12.964377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26979403-e9fe-4a28-aa01-e57bf3a86249 service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:12.964671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26979403-e9fe-4a28-aa01-e57bf3a86249 service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:12.964952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26979403-e9fe-4a28-aa01-e57bf3a86249 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:12.997569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb932aac-9dad-40dd-965e-8b80ee218c99 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:12.999635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26979403-e9fe-4a28-aa01-e57bf3a86249 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:13.001273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26979403-e9fe-4a28-aa01-e57bf3a86249 service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:13.023866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c148-5757-4634-98c7-c1dd050e3b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:13.033962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c148-5757-4634-98c7-c1dd050e3b90 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:13.034247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c148-5757-4634-98c7-c1dd050e3b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:13.035292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c148-5757-4634-98c7-c1dd050e3b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:13.036009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c148-5757-4634-98c7-c1dd050e3b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:13.037996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c148-5757-4634-98c7-c1dd050e3b90 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:13.064663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 868/1710] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:13.066043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9d4d-56fb-45d3-8c13-55176238c5e3 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:13.066333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9d4d-56fb-45d3-8c13-55176238c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:13.066608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9d4d-56fb-45d3-8c13-55176238c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:13.174081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-908d9d4d-56fb-45d3-8c13-55176238c5e3 None None] MFA Rules not processed for user `0db0b77cc6ef4b8aa20d0304ec99e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:13.175381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-908d9d4d-56fb-45d3-8c13-55176238c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:13.201242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 843/1711] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:12 2022] POST /identity/v3/projects => generated 385 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:13.215681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c148-5757-4634-98c7-c1dd050e3b90 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:13.235594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:13.254411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:13.474214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 869/1712] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:13.517463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c148-5757-4634-98c7-c1dd050e3b90 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:13.541941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14312af-cbda-43a9-a411-585a320f12b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:13.541941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14312af-cbda-43a9-a411-585a320f12b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:13.541941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14312af-cbda-43a9-a411-585a320f12b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:13.541941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14312af-cbda-43a9-a411-585a320f12b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:13.542550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14312af-cbda-43a9-a411-585a320f12b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:13.544171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14312af-cbda-43a9-a411-585a320f12b2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:13.648971 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 844/1713] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:13 2022] POST /identity/v3/users => generated 299 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:13.653270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d9d4d-56fb-45d3-8c13-55176238c5e3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:13.672304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d9d4d-56fb-45d3-8c13-55176238c5e3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:13.693245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98603d-cdcd-444e-8e73-506e2917f25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:13.693896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98603d-cdcd-444e-8e73-506e2917f25b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:13.694185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98603d-cdcd-444e-8e73-506e2917f25b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:13.694468 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98603d-cdcd-444e-8e73-506e2917f25b admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:13.702417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98603d-cdcd-444e-8e73-506e2917f25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:13.710307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98603d-cdcd-444e-8e73-506e2917f25b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:13.747951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 870/1714] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:13.748483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14312af-cbda-43a9-a411-585a320f12b2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:13.768713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14312af-cbda-43a9-a411-585a320f12b2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:13.794716 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aae46b-409a-4dfd-85a8-9d448e3ab99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:13.795362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aae46b-409a-4dfd-85a8-9d448e3ab99a admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:13.804640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aae46b-409a-4dfd-85a8-9d448e3ab99a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:13.805010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aae46b-409a-4dfd-85a8-9d448e3ab99a admin admin] PATH_INFO: `/v3/projects/e31378cfa4d14c60b453044b325a6f40/users/77827212722944b4a930d58fc6d8e69b/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:13.904325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aae46b-409a-4dfd-85a8-9d448e3ab99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31378cfa4d14c60b453044b325a6f40, user_id=77827212722944b4a930d58fc6d8e69b, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:13.907139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aae46b-409a-4dfd-85a8-9d448e3ab99a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:13.960214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 845/1715] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:13 2022] PUT /identity/v3/projects/e31378cfa4d14c60b453044b325a6f40/users/77827212722944b4a930d58fc6d8e69b/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:13.964671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98603d-cdcd-444e-8e73-506e2917f25b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:13.978494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98603d-cdcd-444e-8e73-506e2917f25b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:14.211505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbc6d3-ad92-4227-a11b-ca79635b8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:14.220320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc6d3-ad92-4227-a11b-ca79635b8c2d admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:14.221265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc6d3-ad92-4227-a11b-ca79635b8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:14.222048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc6d3-ad92-4227-a11b-ca79635b8c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:14.223402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbc6d3-ad92-4227-a11b-ca79635b8c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:14.228221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbc6d3-ad92-4227-a11b-ca79635b8c2d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:14.257026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 871/1716] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:14.258863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aae46b-409a-4dfd-85a8-9d448e3ab99a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:14.278081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aae46b-409a-4dfd-85a8-9d448e3ab99a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:14.286373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:14.287981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:14.290118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:14.290811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] PATH_INFO: `/v3/projects/e31378cfa4d14c60b453044b325a6f40/users/77827212722944b4a930d58fc6d8e69b/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:14.295617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31378cfa4d14c60b453044b325a6f40, user_id=77827212722944b4a930d58fc6d8e69b, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:14.304058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:14.367043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 846/1717] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:14 2022] PUT /identity/v3/projects/e31378cfa4d14c60b453044b325a6f40/users/77827212722944b4a930d58fc6d8e69b/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:14.379779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e6a9-1be8-46c5-8280-7e4398150303 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:14.380370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e6a9-1be8-46c5-8280-7e4398150303 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:14.380581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e6a9-1be8-46c5-8280-7e4398150303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:14.452025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4439e6a9-1be8-46c5-8280-7e4398150303 None None] MFA Rules not processed for user `77827212722944b4a930d58fc6d8e69b`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:14.454524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4439e6a9-1be8-46c5-8280-7e4398150303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:14.585518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 872/1718] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:14.602501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:14.604966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:14.817190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e09c3c-1167-43d6-8f24-240349acfea1 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:14.841482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5eedd4-8a35-45af-9370-82e8b90702c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:14.842238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eedd4-8a35-45af-9370-82e8b90702c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:14.849179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eedd4-8a35-45af-9370-82e8b90702c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:14.849179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eedd4-8a35-45af-9370-82e8b90702c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:14.889467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5eedd4-8a35-45af-9370-82e8b90702c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:14.889467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5eedd4-8a35-45af-9370-82e8b90702c5 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:14.917331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 847/1719] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:15.128132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e6a9-1be8-46c5-8280-7e4398150303 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:15.281449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:15.400823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e6a9-1be8-46c5-8280-7e4398150303 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:15.415887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:15.416670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:15.417368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:15.418402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] PATH_INFO: `/v3/users/d9bc7eefd3f047d587add8941356d98e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:15.421732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bc7eefd3f047d587add8941356d98e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:15.426037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:15.661621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bc7eefd3f047d587add8941356d98e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:15.687118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bc7eefd3f047d587add8941356d98e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:15.696637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bc7eefd3f047d587add8941356d98e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:15.699439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bc7eefd3f047d587add8941356d98e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:15.721483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bc7eefd3f047d587add8941356d98e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:15.755078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 873/1720] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:15 2022] DELETE /identity/v3/users/d9bc7eefd3f047d587add8941356d98e => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:15.757710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f619aa-4ebc-4470-ab54-67d767b43d8a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:15.757804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f619aa-4ebc-4470-ab54-67d767b43d8a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:15.758074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f619aa-4ebc-4470-ab54-67d767b43d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:15.796846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-55f619aa-4ebc-4470-ab54-67d767b43d8a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:15.801602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-55f619aa-4ebc-4470-ab54-67d767b43d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:16.001685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:16.019067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 848/1721] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:16.032842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:16.036571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:16.216838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ffc4d-2207-455a-95f1-f2ae9e2de31c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:16.237586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:16.239449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:16.239815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:16.240107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:16.270632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:16.272802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:16.310707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 874/1722] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:16.531865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f619aa-4ebc-4470-ab54-67d767b43d8a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:16.533675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-55f619aa-4ebc-4470-ab54-67d767b43d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:16.692516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f619aa-4ebc-4470-ab54-67d767b43d8a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:16.702118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:16.702779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:16.703821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:16.704105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:16.713257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:16.902526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:16.904038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:16.923085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 849/1723] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:17.492213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:17.497759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:17.517796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d32c-00d9-41c7-9337-78b127444262 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:17.535795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:17.536735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:17.537206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:17.537724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] PATH_INFO: `/v3/projects/6f70c404a11f4584a140b0d852ee7832` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:17.539207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f70c404a11f4584a140b0d852ee7832)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:17.542794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:17.643030 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:17.649327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f70c404a11f4584a140b0d852ee7832', 'request_id': 'req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:17.664019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f70c404a11f4584a140b0d852ee7832', 'request_id': 'req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:17.679578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f70c404a11f4584a140b0d852ee7832', 'request_id': 'req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:17.694804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] The token cache is being invalidate because project 6f70c404a11f4584a140b0d852ee7832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:17.695688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:17.697134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0dc8a93c-73f9-4579-b95d-6b2e41ebcdad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:17.699635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 875/1724] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:17 2022] DELETE /identity/v3/projects/6f70c404a11f4584a140b0d852ee7832 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:17.703636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:17.716217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b8bb-ee57-4dde-9ecc-7e9ddae516e8 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:17.951280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:17.954143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:17.954444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:17.954729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] PATH_INFO: `/v3/users/9423e518883c48faada4cd4ba5b0810c` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:17.960316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9423e518883c48faada4cd4ba5b0810c)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:17.967767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:18.088497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a1b5-5e67-41bc-8958-82e273be8867 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:18.089133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a1b5-5e67-41bc-8958-82e273be8867 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:18.089574 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a1b5-5e67-41bc-8958-82e273be8867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:18.216752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9423e518883c48faada4cd4ba5b0810c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:18.240826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:18.247493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9423e518883c48faada4cd4ba5b0810c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:18.254088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9423e518883c48faada4cd4ba5b0810c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:18.281329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-0d32a1b5-5e67-41bc-8958-82e273be8867 None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:18.294421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0d32a1b5-5e67-41bc-8958-82e273be8867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:18.312679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9423e518883c48faada4cd4ba5b0810c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:18.313662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9423e518883c48faada4cd4ba5b0810c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:18.422217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 850/1725] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:17 2022] DELETE /identity/v3/users/9423e518883c48faada4cd4ba5b0810c => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:18.630751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 876/1726] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:52:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 26 07:52:18.893567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:18.896052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:19.126640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af19d0-a61d-4b06-bc11-34609805cadb admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:19.135841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56e1eb-70dc-493b-afcd-eed1453fbb32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:19.136837 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e1eb-70dc-493b-afcd-eed1453fbb32 service swift] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:19.137447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e1eb-70dc-493b-afcd-eed1453fbb32 service swift] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:19.138115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e1eb-70dc-493b-afcd-eed1453fbb32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:19.221963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56e1eb-70dc-493b-afcd-eed1453fbb32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:19.224539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56e1eb-70dc-493b-afcd-eed1453fbb32 service swift] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:19.262791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 851/1727] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:52:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:52:19.878967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a1b5-5e67-41bc-8958-82e273be8867 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:19.880831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0d32a1b5-5e67-41bc-8958-82e273be8867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:19.907605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a1b5-5e67-41bc-8958-82e273be8867 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:20.039099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:20.041514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:20.043291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:20.043579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] PATH_INFO: `/v3/projects/b25fcfdc29a14a138e55470cf6579d93` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:20.046029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25fcfdc29a14a138e55470cf6579d93)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:20.049467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:20.163908 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:20.167101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25fcfdc29a14a138e55470cf6579d93', 'request_id': 'req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:20.181071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25fcfdc29a14a138e55470cf6579d93', 'request_id': 'req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:20.190368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25fcfdc29a14a138e55470cf6579d93', 'request_id': 'req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:20.205174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] The token cache is being invalidate because project b25fcfdc29a14a138e55470cf6579d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:20.205473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:20.206290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3d4725c4-ec6f-4ad2-873e-c8605581b0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:20.213277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 877/1728] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:19 2022] DELETE /identity/v3/projects/b25fcfdc29a14a138e55470cf6579d93 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:20.215475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27c8-84d8-4071-b9ea-b4e2bbdda482 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:20.215944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27c8-84d8-4071-b9ea-b4e2bbdda482 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:20.216050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27c8-84d8-4071-b9ea-b4e2bbdda482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:20.248364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ddfb27c8-84d8-4071-b9ea-b4e2bbdda482 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:20.249790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ddfb27c8-84d8-4071-b9ea-b4e2bbdda482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:20.403179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:20.435115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 852/1729] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:20.443342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83de11-abb7-4fbe-a7c7-8c0292df3cc9 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:20.444907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83de11-abb7-4fbe-a7c7-8c0292df3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:20.445306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83de11-abb7-4fbe-a7c7-8c0292df3cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:20.494628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8b83de11-abb7-4fbe-a7c7-8c0292df3cc9 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:20.501374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8b83de11-abb7-4fbe-a7c7-8c0292df3cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:20.518404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 878/1730] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:20.523044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb27c8-84d8-4071-b9ea-b4e2bbdda482 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:20.554346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb27c8-84d8-4071-b9ea-b4e2bbdda482 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:20.562238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:20.563162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:20.563510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:20.563877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:20.565790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:20.566178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:20.568670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:20.594547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 853/1731] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:20.608107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83de11-abb7-4fbe-a7c7-8c0292df3cc9 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:20.620771 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83de11-abb7-4fbe-a7c7-8c0292df3cc9 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:20.628346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a6fe-b1ac-4322-83fa-42f0bc743285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:20.628992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a6fe-b1ac-4322-83fa-42f0bc743285 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:20.629488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a6fe-b1ac-4322-83fa-42f0bc743285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:20.629724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a6fe-b1ac-4322-83fa-42f0bc743285 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:20.630471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805a6fe-b1ac-4322-83fa-42f0bc743285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:20.635560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805a6fe-b1ac-4322-83fa-42f0bc743285 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:20.716206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 879/1732] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:20 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:20.720153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:20.740343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3172-25bf-4e92-b6af-3913369d146a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:20.846922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc31d-a75c-436a-b657-6aa3eb48ea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:20.847857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc31d-a75c-436a-b657-6aa3eb48ea45 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:20.848801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc31d-a75c-436a-b657-6aa3eb48ea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:20.848801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc31d-a75c-436a-b657-6aa3eb48ea45 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:20.851384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fc31d-a75c-436a-b657-6aa3eb48ea45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:20.853549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fc31d-a75c-436a-b657-6aa3eb48ea45 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:20.881535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 854/1733] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:20 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:20.883406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a6fe-b1ac-4322-83fa-42f0bc743285 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:20.903591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a6fe-b1ac-4322-83fa-42f0bc743285 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:20.921537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f7f9-5751-4cd4-8975-e0c06a55f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:20.923515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f7f9-5751-4cd4-8975-e0c06a55f51e admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:20.923515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f7f9-5751-4cd4-8975-e0c06a55f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:20.923515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f7f9-5751-4cd4-8975-e0c06a55f51e admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:20.924235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f7f9-5751-4cd4-8975-e0c06a55f51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:20.925912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f7f9-5751-4cd4-8975-e0c06a55f51e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:20.945202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc31d-a75c-436a-b657-6aa3eb48ea45 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:20.956451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 880/1734] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:20.957955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc31d-a75c-436a-b657-6aa3eb48ea45 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:20.965006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51999ec-8f52-4004-90f5-c92262e32cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:20.965655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51999ec-8f52-4004-90f5-c92262e32cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:20.966261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51999ec-8f52-4004-90f5-c92262e32cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:20.966261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51999ec-8f52-4004-90f5-c92262e32cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:20.966917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51999ec-8f52-4004-90f5-c92262e32cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:20.969506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51999ec-8f52-4004-90f5-c92262e32cf1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:20.991286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f7f9-5751-4cd4-8975-e0c06a55f51e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:20.992713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 855/1735] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:21.007787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f7f9-5751-4cd4-8975-e0c06a55f51e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:21.013264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb442b37-4f39-4857-a7e0-f0876a311b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:21.014242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb442b37-4f39-4857-a7e0-f0876a311b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:21.014721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb442b37-4f39-4857-a7e0-f0876a311b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:21.015221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb442b37-4f39-4857-a7e0-f0876a311b01 admin admin] PATH_INFO: `/v3/projects/c697a9b13cbf411eb659fa4470aee62a/users/f80a3ce2174f4f059152bd32f95db548/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:21.064307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb442b37-4f39-4857-a7e0-f0876a311b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c697a9b13cbf411eb659fa4470aee62a, user_id=f80a3ce2174f4f059152bd32f95db548, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:21.068305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb442b37-4f39-4857-a7e0-f0876a311b01 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:21.107965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 881/1736] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:20 2022] PUT /identity/v3/projects/c697a9b13cbf411eb659fa4470aee62a/users/f80a3ce2174f4f059152bd32f95db548/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:21.120861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d7fed-05b7-4c00-a23e-110a82818aeb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:21.121221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d7fed-05b7-4c00-a23e-110a82818aeb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:21.121483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d7fed-05b7-4c00-a23e-110a82818aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:21.232468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-544d7fed-05b7-4c00-a23e-110a82818aeb None None] MFA Rules not processed for user `f80a3ce2174f4f059152bd32f95db548`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:21.235136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-544d7fed-05b7-4c00-a23e-110a82818aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:21.369625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 856/1737] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:21.373709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb442b37-4f39-4857-a7e0-f0876a311b01 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:21.534031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb442b37-4f39-4857-a7e0-f0876a311b01 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:21.541753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6410f37-9db1-4fdb-ad7f-3108262afe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:21.544143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6410f37-9db1-4fdb-ad7f-3108262afe78 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:21.544498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6410f37-9db1-4fdb-ad7f-3108262afe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:21.544790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6410f37-9db1-4fdb-ad7f-3108262afe78 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:21.545489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6410f37-9db1-4fdb-ad7f-3108262afe78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:21.551172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6410f37-9db1-4fdb-ad7f-3108262afe78 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:21.646428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 882/1738] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:21 2022] POST /identity/v3/projects => generated 371 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:21.650330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d7fed-05b7-4c00-a23e-110a82818aeb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:21.666079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d7fed-05b7-4c00-a23e-110a82818aeb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:21.740631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:21.758352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec57b7f-88b9-4408-ba43-17ec4e90e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:21.759123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec57b7f-88b9-4408-ba43-17ec4e90e0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:21.759886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec57b7f-88b9-4408-ba43-17ec4e90e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:21.760170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec57b7f-88b9-4408-ba43-17ec4e90e0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:21.762076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec57b7f-88b9-4408-ba43-17ec4e90e0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:21.763296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec57b7f-88b9-4408-ba43-17ec4e90e0a6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:21.794660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 857/1739] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:21 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:21.798725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6410f37-9db1-4fdb-ad7f-3108262afe78 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:21.812514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6410f37-9db1-4fdb-ad7f-3108262afe78 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:21.819317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d5eb-8e87-44e6-bd59-e8b4eaf62e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:21.820456 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d5eb-8e87-44e6-bd59-e8b4eaf62e86 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:21.820690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d5eb-8e87-44e6-bd59-e8b4eaf62e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:21.820975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d5eb-8e87-44e6-bd59-e8b4eaf62e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:21.822412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d5eb-8e87-44e6-bd59-e8b4eaf62e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:21.824496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d5eb-8e87-44e6-bd59-e8b4eaf62e86 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:21.842135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 883/1740] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:21.846720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec57b7f-88b9-4408-ba43-17ec4e90e0a6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:21.862209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec57b7f-88b9-4408-ba43-17ec4e90e0a6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:21.872870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eee77-ba74-4e55-8c7f-98f96a87b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:21.873560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eee77-ba74-4e55-8c7f-98f96a87b965 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:21.873841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eee77-ba74-4e55-8c7f-98f96a87b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:21.874125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eee77-ba74-4e55-8c7f-98f96a87b965 admin admin] PATH_INFO: `/v3/projects/2435eb0cd42a4049b994530ac74ec9b9/users/117126dbfc7e41cba62101335a6d5fcf/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:21.919268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023eee77-ba74-4e55-8c7f-98f96a87b965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2435eb0cd42a4049b994530ac74ec9b9, user_id=117126dbfc7e41cba62101335a6d5fcf, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:21.922821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023eee77-ba74-4e55-8c7f-98f96a87b965 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:21.953178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 858/1741] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:21 2022] PUT /identity/v3/projects/2435eb0cd42a4049b994530ac74ec9b9/users/117126dbfc7e41cba62101335a6d5fcf/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:21.958325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d5eb-8e87-44e6-bd59-e8b4eaf62e86 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:21.976375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d5eb-8e87-44e6-bd59-e8b4eaf62e86 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:22.058889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:22.075301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd7042-78c6-4954-a9d2-f3ec57be1753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:22.075930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7042-78c6-4954-a9d2-f3ec57be1753 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:22.076215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7042-78c6-4954-a9d2-f3ec57be1753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:22.076490 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd7042-78c6-4954-a9d2-f3ec57be1753 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:22.077189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd7042-78c6-4954-a9d2-f3ec57be1753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:22.078783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd7042-78c6-4954-a9d2-f3ec57be1753 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:22.089561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 884/1742] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:22.093588 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eee77-ba74-4e55-8c7f-98f96a87b965 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:22.104051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eee77-ba74-4e55-8c7f-98f96a87b965 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:22.108963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:22.109644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:22.109953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:22.110257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] PATH_INFO: `/v3/projects/2435eb0cd42a4049b994530ac74ec9b9/users/117126dbfc7e41cba62101335a6d5fcf/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:22.112630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2435eb0cd42a4049b994530ac74ec9b9, user_id=117126dbfc7e41cba62101335a6d5fcf, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:22.115348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:22.137469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 859/1743] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:22 2022] PUT /identity/v3/projects/2435eb0cd42a4049b994530ac74ec9b9/users/117126dbfc7e41cba62101335a6d5fcf/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:22.146966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9a966-8aa8-4dfc-b9b2-c8b084c75abb None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:22.147354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9a966-8aa8-4dfc-b9b2-c8b084c75abb None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:22.147797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9a966-8aa8-4dfc-b9b2-c8b084c75abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:22.182846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-31c9a966-8aa8-4dfc-b9b2-c8b084c75abb None None] MFA Rules not processed for user `117126dbfc7e41cba62101335a6d5fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:22.184880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-31c9a966-8aa8-4dfc-b9b2-c8b084c75abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:22.309307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 885/1744] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:22.324185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:22.326077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:22.445809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9731c-c714-4539-867b-d7820b7bda6d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:22.450773 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7f8f1-5376-48cf-a2ef-b8b8af82f275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:22.451619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f8f1-5376-48cf-a2ef-b8b8af82f275 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:22.452209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f8f1-5376-48cf-a2ef-b8b8af82f275 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:22.452657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f8f1-5376-48cf-a2ef-b8b8af82f275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:22.464495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f8f1-5376-48cf-a2ef-b8b8af82f275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:22.466748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7f8f1-5376-48cf-a2ef-b8b8af82f275 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:22.477273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 860/1745] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:22.961844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9a966-8aa8-4dfc-b9b2-c8b084c75abb None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:23.046462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9a966-8aa8-4dfc-b9b2-c8b084c75abb None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:23.051327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:23.051986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:23.052274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:23.052555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] PATH_INFO: `/v3/users/f80a3ce2174f4f059152bd32f95db548` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:23.053751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80a3ce2174f4f059152bd32f95db548)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:23.055710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:23.108135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80a3ce2174f4f059152bd32f95db548'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.116167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80a3ce2174f4f059152bd32f95db548'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.123416 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80a3ce2174f4f059152bd32f95db548'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.124006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80a3ce2174f4f059152bd32f95db548'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.129466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:23.142502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80a3ce2174f4f059152bd32f95db548'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.149611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 886/1746] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:22 2022] DELETE /identity/v3/users/f80a3ce2174f4f059152bd32f95db548 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:23.154408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33320052-408f-4e85-8274-15ee818d284c None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:23.154700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33320052-408f-4e85-8274-15ee818d284c None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:23.155011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33320052-408f-4e85-8274-15ee818d284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:23.174034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-33320052-408f-4e85-8274-15ee818d284c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:23.175274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-33320052-408f-4e85-8274-15ee818d284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:23.232568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 861/1747] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:23.242608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:23.244203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:23.326804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90a0be-3f7e-41f5-98c7-6efde004e0b0 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:23.330156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b251e-22a1-4af5-b4da-7a4b2820769e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:23.330788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b251e-22a1-4af5-b4da-7a4b2820769e service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:23.331133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b251e-22a1-4af5-b4da-7a4b2820769e service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:23.331401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b251e-22a1-4af5-b4da-7a4b2820769e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:23.342557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b251e-22a1-4af5-b4da-7a4b2820769e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:23.344204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b251e-22a1-4af5-b4da-7a4b2820769e service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:23.354611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 887/1748] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:23.659387 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33320052-408f-4e85-8274-15ee818d284c None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:23.660875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-33320052-408f-4e85-8274-15ee818d284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:23.673508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33320052-408f-4e85-8274-15ee818d284c None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:23.678175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:23.678888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:23.679358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:23.679793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] PATH_INFO: `/v3/projects/c697a9b13cbf411eb659fa4470aee62a` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:23.681173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c697a9b13cbf411eb659fa4470aee62a)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:23.683122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:23.723608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:23.731207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c697a9b13cbf411eb659fa4470aee62a', 'request_id': 'req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.737453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c697a9b13cbf411eb659fa4470aee62a', 'request_id': 'req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.746160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c697a9b13cbf411eb659fa4470aee62a', 'request_id': 'req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.757222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] The token cache is being invalidate because project c697a9b13cbf411eb659fa4470aee62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:23.757510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.758140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.760324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 862/1749] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:23 2022] DELETE /identity/v3/projects/c697a9b13cbf411eb659fa4470aee62a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:23.764651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b251e-22a1-4af5-b4da-7a4b2820769e service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:23.774159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b251e-22a1-4af5-b4da-7a4b2820769e service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:23.833533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:23.834182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:23.834476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:23.834740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] PATH_INFO: `/v3/users/117126dbfc7e41cba62101335a6d5fcf` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:23.835937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=117126dbfc7e41cba62101335a6d5fcf)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:23.838269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:23.883505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117126dbfc7e41cba62101335a6d5fcf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.891420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117126dbfc7e41cba62101335a6d5fcf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.898245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117126dbfc7e41cba62101335a6d5fcf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.898899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117126dbfc7e41cba62101335a6d5fcf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.910984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-46589916-83ca-4548-97c6-10e0415d38c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117126dbfc7e41cba62101335a6d5fcf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:23.916948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 888/1750] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:23 2022] DELETE /identity/v3/users/117126dbfc7e41cba62101335a6d5fcf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:24.448672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:24.451583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:24.473731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92f2bd-95bb-4edb-b4e6-ba91750c6eb9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:24.593663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:24.595157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:24.595720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:24.596140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] PATH_INFO: `/v3/projects/2435eb0cd42a4049b994530ac74ec9b9` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:24.597975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2435eb0cd42a4049b994530ac74ec9b9)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:24.600689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:24.685873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2435eb0cd42a4049b994530ac74ec9b9', 'request_id': 'req-e8963714-9ec9-4644-bcba-e50bd79dfa58'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:24.697813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2435eb0cd42a4049b994530ac74ec9b9', 'request_id': 'req-e8963714-9ec9-4644-bcba-e50bd79dfa58'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:24.705802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2435eb0cd42a4049b994530ac74ec9b9', 'request_id': 'req-e8963714-9ec9-4644-bcba-e50bd79dfa58'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:24.716914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] The token cache is being invalidate because project 2435eb0cd42a4049b994530ac74ec9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:24.717231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:24.717867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e8963714-9ec9-4644-bcba-e50bd79dfa58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:24.719448 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 863/1751] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:24 2022] DELETE /identity/v3/projects/2435eb0cd42a4049b994530ac74ec9b9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:24.724304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1dcc-2fd3-49b0-b9f1-44c04556c496 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:24.724785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1dcc-2fd3-49b0-b9f1-44c04556c496 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:24.724880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1dcc-2fd3-49b0-b9f1-44c04556c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:24.746590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-064f1dcc-2fd3-49b0-b9f1-44c04556c496 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:24.747870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-064f1dcc-2fd3-49b0-b9f1-44c04556c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:24.752176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:24.812973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 889/1752] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:24.820802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e09b-ebb1-4961-bb12-23feddf7123e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:24.822118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e09b-ebb1-4961-bb12-23feddf7123e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:24.822689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e09b-ebb1-4961-bb12-23feddf7123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:24.856054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8b62e09b-ebb1-4961-bb12-23feddf7123e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:24.857424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8b62e09b-ebb1-4961-bb12-23feddf7123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:24.866976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 864/1753] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:24.870562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1dcc-2fd3-49b0-b9f1-44c04556c496 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:24.882347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1dcc-2fd3-49b0-b9f1-44c04556c496 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:24.891144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:24.891998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:24.892425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:24.892844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:24.893701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:24.894150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:24.896090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:24.909094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 890/1754] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:24.913551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62e09b-ebb1-4961-bb12-23feddf7123e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:24.922708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62e09b-ebb1-4961-bb12-23feddf7123e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:24.927727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a662621-61ed-4354-ac6f-064a9b2de4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:24.928357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a662621-61ed-4354-ac6f-064a9b2de4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:24.928640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a662621-61ed-4354-ac6f-064a9b2de4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:24.928915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a662621-61ed-4354-ac6f-064a9b2de4d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:24.929662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a662621-61ed-4354-ac6f-064a9b2de4d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:24.931661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a662621-61ed-4354-ac6f-064a9b2de4d6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:24.959982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 865/1755] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:24 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:24.964667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:24.974592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4963c-ac7f-4157-a12a-403f4b2a3e41 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.030997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead8236-54d5-4016-a041-4cad2170f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.031618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead8236-54d5-4016-a041-4cad2170f643 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.031902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead8236-54d5-4016-a041-4cad2170f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.032179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead8236-54d5-4016-a041-4cad2170f643 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.032855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead8236-54d5-4016-a041-4cad2170f643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.034774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead8236-54d5-4016-a041-4cad2170f643 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.055780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 891/1756] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:24 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:25.059932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a662621-61ed-4354-ac6f-064a9b2de4d6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.070320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a662621-61ed-4354-ac6f-064a9b2de4d6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.075438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9908b-c306-4ee3-9580-febeae738d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.076048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9908b-c306-4ee3-9580-febeae738d6e admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.076334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9908b-c306-4ee3-9580-febeae738d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.076626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9908b-c306-4ee3-9580-febeae738d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.077306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9908b-c306-4ee3-9580-febeae738d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.078935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9908b-c306-4ee3-9580-febeae738d6e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.089694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 866/1757] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:25.094557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead8236-54d5-4016-a041-4cad2170f643 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.111786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead8236-54d5-4016-a041-4cad2170f643 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.116585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddecac-9139-4a3b-9aad-35143a8c487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.117220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddecac-9139-4a3b-9aad-35143a8c487b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.117505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddecac-9139-4a3b-9aad-35143a8c487b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.117779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddecac-9139-4a3b-9aad-35143a8c487b admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.118515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddecac-9139-4a3b-9aad-35143a8c487b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.120247 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddecac-9139-4a3b-9aad-35143a8c487b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.136622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 892/1758] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:25.141502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9908b-c306-4ee3-9580-febeae738d6e admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.154179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9908b-c306-4ee3-9580-febeae738d6e admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.158973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e407be-c158-4cce-9650-37b1d6a13231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.159686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e407be-c158-4cce-9650-37b1d6a13231 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.165263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e407be-c158-4cce-9650-37b1d6a13231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.165499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e407be-c158-4cce-9650-37b1d6a13231 admin admin] PATH_INFO: `/v3/projects/07346aaead1a4873bd9b8174ee75da7e/users/0fc62b2876784fd1bfa02650dc18e964/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.180882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e407be-c158-4cce-9650-37b1d6a13231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07346aaead1a4873bd9b8174ee75da7e, user_id=0fc62b2876784fd1bfa02650dc18e964, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.183577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e407be-c158-4cce-9650-37b1d6a13231 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.185751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:25.198619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 867/1759] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:25 2022] PUT /identity/v3/projects/07346aaead1a4873bd9b8174ee75da7e/users/0fc62b2876784fd1bfa02650dc18e964/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:25.209974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ed6c-025e-4b9c-8086-6073fc594ad0 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.210204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ed6c-025e-4b9c-8086-6073fc594ad0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.210522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ed6c-025e-4b9c-8086-6073fc594ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.239442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3ec6ed6c-025e-4b9c-8086-6073fc594ad0 None None] MFA Rules not processed for user `0fc62b2876784fd1bfa02650dc18e964`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:25.240704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3ec6ed6c-025e-4b9c-8086-6073fc594ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:25.305792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 893/1760] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:25.310801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e407be-c158-4cce-9650-37b1d6a13231 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.376701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e407be-c158-4cce-9650-37b1d6a13231 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.382100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4812-bee5-41d8-8c3a-e660c5b25638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.382728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4812-bee5-41d8-8c3a-e660c5b25638 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.383043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4812-bee5-41d8-8c3a-e660c5b25638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.383327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4812-bee5-41d8-8c3a-e660c5b25638 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.391760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4812-bee5-41d8-8c3a-e660c5b25638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.394944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4812-bee5-41d8-8c3a-e660c5b25638 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.428755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 868/1761] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:25 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:25.430524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ed6c-025e-4b9c-8086-6073fc594ad0 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.442107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:25.450751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ed6c-025e-4b9c-8086-6073fc594ad0 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.566301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b390a-f3d2-4e25-a628-7daccda117a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.567457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b390a-f3d2-4e25-a628-7daccda117a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.568028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b390a-f3d2-4e25-a628-7daccda117a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.568380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b390a-f3d2-4e25-a628-7daccda117a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.569599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b390a-f3d2-4e25-a628-7daccda117a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.574436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b390a-f3d2-4e25-a628-7daccda117a3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.620089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 894/1762] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:25 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:25.624555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4812-bee5-41d8-8c3a-e660c5b25638 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.638426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4812-bee5-41d8-8c3a-e660c5b25638 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.644687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89cfd-78d7-47a5-949d-a8025c2066dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.644987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89cfd-78d7-47a5-949d-a8025c2066dc admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.645273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89cfd-78d7-47a5-949d-a8025c2066dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.645546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89cfd-78d7-47a5-949d-a8025c2066dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.646299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a89cfd-78d7-47a5-949d-a8025c2066dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.650646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a89cfd-78d7-47a5-949d-a8025c2066dc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.668214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 869/1763] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:25.668923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b390a-f3d2-4e25-a628-7daccda117a3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.679967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b390a-f3d2-4e25-a628-7daccda117a3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.686064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28767f23-21bb-495d-bde0-cfb7d76a45d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.686567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28767f23-21bb-495d-bde0-cfb7d76a45d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.687008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28767f23-21bb-495d-bde0-cfb7d76a45d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.687190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28767f23-21bb-495d-bde0-cfb7d76a45d0 admin admin] PATH_INFO: `/v3/projects/06a09c9e4f024a21bf5dd1a8559832f5/users/c619501a32ee45eda23bf0a62185ed21/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.705429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28767f23-21bb-495d-bde0-cfb7d76a45d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a09c9e4f024a21bf5dd1a8559832f5, user_id=c619501a32ee45eda23bf0a62185ed21, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.708477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28767f23-21bb-495d-bde0-cfb7d76a45d0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.731573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 895/1764] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:25 2022] PUT /identity/v3/projects/06a09c9e4f024a21bf5dd1a8559832f5/users/c619501a32ee45eda23bf0a62185ed21/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:25.732146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89cfd-78d7-47a5-949d-a8025c2066dc admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.747737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89cfd-78d7-47a5-949d-a8025c2066dc admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.864174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087281da-2d8b-46bf-a333-9ee5a1d7450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.864914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087281da-2d8b-46bf-a333-9ee5a1d7450e admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.865849 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087281da-2d8b-46bf-a333-9ee5a1d7450e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.866487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087281da-2d8b-46bf-a333-9ee5a1d7450e admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.867816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087281da-2d8b-46bf-a333-9ee5a1d7450e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.871469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087281da-2d8b-46bf-a333-9ee5a1d7450e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.893561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 870/1765] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:25.897957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28767f23-21bb-495d-bde0-cfb7d76a45d0 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:25.911102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28767f23-21bb-495d-bde0-cfb7d76a45d0 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:25.921474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:25.922275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.922695 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.923112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] PATH_INFO: `/v3/projects/06a09c9e4f024a21bf5dd1a8559832f5/users/c619501a32ee45eda23bf0a62185ed21/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:25.926027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a09c9e4f024a21bf5dd1a8559832f5, user_id=c619501a32ee45eda23bf0a62185ed21, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:25.930171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:25.975219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 896/1766] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:25 2022] PUT /identity/v3/projects/06a09c9e4f024a21bf5dd1a8559832f5/users/c619501a32ee45eda23bf0a62185ed21/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:25.988467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147433-2f08-47e8-8735-5fddc7e1e42b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:25.988983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147433-2f08-47e8-8735-5fddc7e1e42b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:25.989398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147433-2f08-47e8-8735-5fddc7e1e42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:26.025913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d0147433-2f08-47e8-8735-5fddc7e1e42b None None] MFA Rules not processed for user `c619501a32ee45eda23bf0a62185ed21`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:26.027513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d0147433-2f08-47e8-8735-5fddc7e1e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:26.085936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:26.107650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 871/1767] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:26.118798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:26.121386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:26.203487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0147433-2f08-47e8-8735-5fddc7e1e42b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:26.206216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d0147433-2f08-47e8-8735-5fddc7e1e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:26.212870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4e49c-110a-4c9d-be4d-ff6f55fd7903 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:26.220723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0147433-2f08-47e8-8735-5fddc7e1e42b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:26.225132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:26.226435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:26.226435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:26.226629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:26.230417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:26.236826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:26.238178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:26.238816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:26.239272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:26.256947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:26.258999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:26.277300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 897/1768] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:26.336402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:26.344089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:26.366323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 872/1769] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:27.227479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:27.230237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:27.378707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac5203-da56-434c-8ffd-66b9ec0c444f service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:27.390264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:27.391117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:27.391506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:27.393469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] PATH_INFO: `/v3/users/63f3f5bddc8b4aa58a34e10d60aeb0ea` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:27.395439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f3f5bddc8b4aa58a34e10d60aeb0ea)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:27.399855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:27.402923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:27.515239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f3f5bddc8b4aa58a34e10d60aeb0ea'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.536822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f3f5bddc8b4aa58a34e10d60aeb0ea'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.548596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f3f5bddc8b4aa58a34e10d60aeb0ea'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.549502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f3f5bddc8b4aa58a34e10d60aeb0ea'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.575041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-29585a15-26b1-496c-8621-6c3b60223383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f3f5bddc8b4aa58a34e10d60aeb0ea'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.580228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:27.586424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 898/1770] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:27 2022] DELETE /identity/v3/users/63f3f5bddc8b4aa58a34e10d60aeb0ea => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:27.595548 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63457-857c-4035-aadc-7bde34f9920e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:27.595837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63457-857c-4035-aadc-7bde34f9920e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:27.596113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63457-857c-4035-aadc-7bde34f9920e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:27.602121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db070-de1a-415c-a156-812351c1fbfb service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:27.639029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ecb63457-857c-4035-aadc-7bde34f9920e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:27.640447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ecb63457-857c-4035-aadc-7bde34f9920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:27.726379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:27.727082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:27.727359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:27.727654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] PATH_INFO: `/v3/users/0fc62b2876784fd1bfa02650dc18e964` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:27.729425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc62b2876784fd1bfa02650dc18e964)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:27.731715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:27.777190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 899/1771] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:27.788208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb63457-857c-4035-aadc-7bde34f9920e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:27.791644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ecb63457-857c-4035-aadc-7bde34f9920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:27.835437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc62b2876784fd1bfa02650dc18e964'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.847261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc62b2876784fd1bfa02650dc18e964'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.848359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc62b2876784fd1bfa02650dc18e964'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.868094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc62b2876784fd1bfa02650dc18e964'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.868953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5466dbde-4bf9-48bf-bb52-c0d020d7c2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc62b2876784fd1bfa02650dc18e964'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:27.891536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb63457-857c-4035-aadc-7bde34f9920e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:27.898129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 873/1772] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:27 2022] DELETE /identity/v3/users/0fc62b2876784fd1bfa02650dc18e964 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:27.900651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:27.901323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:27.901734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:27.901913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:27.904125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd58f-1420-48c0-b0ab-2dc4ca237b63 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:27.904342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:27.904507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd58f-1420-48c0-b0ab-2dc4ca237b63 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:27.904761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddd58f-1420-48c0-b0ab-2dc4ca237b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:27.920241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:27.921709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:27.923282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:27.928495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-51ddd58f-1420-48c0-b0ab-2dc4ca237b63 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:27.935163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-51ddd58f-1420-48c0-b0ab-2dc4ca237b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:27.938971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 900/1773] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:28.038372 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 874/1774] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:28.049632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:28.051119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:28.073529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc0e16-cf87-4a7b-b561-790e52c05731 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:28.132073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:28.206287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac75844-3310-4b4c-903d-4b21622472e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:28.206944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac75844-3310-4b4c-903d-4b21622472e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:28.207258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac75844-3310-4b4c-903d-4b21622472e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:28.207537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac75844-3310-4b4c-903d-4b21622472e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:28.224934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac75844-3310-4b4c-903d-4b21622472e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:28.230824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac75844-3310-4b4c-903d-4b21622472e5 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:28.257712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 901/1775] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:28.411845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddd58f-1420-48c0-b0ab-2dc4ca237b63 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:28.413374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-51ddd58f-1420-48c0-b0ab-2dc4ca237b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:28.438122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddd58f-1420-48c0-b0ab-2dc4ca237b63 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:28.447135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:28.447987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:28.448250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:28.448528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] PATH_INFO: `/v3/projects/edd63e4d52054e8984ae925e991270cb` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:28.449781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd63e4d52054e8984ae925e991270cb)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:28.451962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:28.515208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd63e4d52054e8984ae925e991270cb', 'request_id': 'req-e404aa47-8e01-4808-bd07-ecb7c814dfe4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.522462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd63e4d52054e8984ae925e991270cb', 'request_id': 'req-e404aa47-8e01-4808-bd07-ecb7c814dfe4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.534187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd63e4d52054e8984ae925e991270cb', 'request_id': 'req-e404aa47-8e01-4808-bd07-ecb7c814dfe4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.549942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] The token cache is being invalidate because project edd63e4d52054e8984ae925e991270cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:28.550288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.551022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.556635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 875/1776] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:28 2022] DELETE /identity/v3/projects/edd63e4d52054e8984ae925e991270cb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:28.559126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6c532-9e03-4a88-9c66-ee63e59a90af None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:28.559422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6c532-9e03-4a88-9c66-ee63e59a90af None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:28.559704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6c532-9e03-4a88-9c66-ee63e59a90af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:28.589640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-44c6c532-9e03-4a88-9c66-ee63e59a90af None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:28.590843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-44c6c532-9e03-4a88-9c66-ee63e59a90af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:28.717287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:28.719037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:28.734999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 902/1777] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:28.748821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404aa47-8e01-4808-bd07-ecb7c814dfe4 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:28.753563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acaf58-368b-40e1-8afd-7c839532c5e9 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:28.758848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acaf58-368b-40e1-8afd-7c839532c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:28.759796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acaf58-368b-40e1-8afd-7c839532c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:28.767134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:28.769803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:28.770974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:28.771427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] PATH_INFO: `/v3/projects/07346aaead1a4873bd9b8174ee75da7e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:28.776519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07346aaead1a4873bd9b8174ee75da7e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:28.780619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:28.806682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c3acaf58-368b-40e1-8afd-7c839532c5e9 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:28.808104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c3acaf58-368b-40e1-8afd-7c839532c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:28.835956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 903/1778] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:28.840464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acaf58-368b-40e1-8afd-7c839532c5e9 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:28.870724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acaf58-368b-40e1-8afd-7c839532c5e9 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:28.889422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07346aaead1a4873bd9b8174ee75da7e', 'request_id': 'req-b00e282c-6197-4f09-bdb3-8360bc59df2c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.897366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07346aaead1a4873bd9b8174ee75da7e', 'request_id': 'req-b00e282c-6197-4f09-bdb3-8360bc59df2c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.909505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07346aaead1a4873bd9b8174ee75da7e', 'request_id': 'req-b00e282c-6197-4f09-bdb3-8360bc59df2c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.926087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] The token cache is being invalidate because project 07346aaead1a4873bd9b8174ee75da7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:28.926417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.927955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:28.929829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 876/1779] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:28 2022] DELETE /identity/v3/projects/07346aaead1a4873bd9b8174ee75da7e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:28.933683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:28.935470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:28.951242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:28.959511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:28.960533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:28.960739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:28.961016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:28.961716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:28.962044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:28.964267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:28.982761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 904/1780] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:28.987329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:28.989005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:29.005367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d273-8ab1-4a24-b862-87ec9a1a21aa admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.011485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de754bd6-50e1-49c2-9974-65eedc2057d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.012116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de754bd6-50e1-49c2-9974-65eedc2057d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.012405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de754bd6-50e1-49c2-9974-65eedc2057d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.012949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de754bd6-50e1-49c2-9974-65eedc2057d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.013656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de754bd6-50e1-49c2-9974-65eedc2057d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.013850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e282c-6197-4f09-bdb3-8360bc59df2c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.015622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de754bd6-50e1-49c2-9974-65eedc2057d0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.019353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.020229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.020585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.020870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] PATH_INFO: `/v3/users/c619501a32ee45eda23bf0a62185ed21` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.022056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c619501a32ee45eda23bf0a62185ed21)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.024068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.045902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 905/1781] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:28 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:29.049731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de754bd6-50e1-49c2-9974-65eedc2057d0 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.082420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c619501a32ee45eda23bf0a62185ed21'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.088300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:29.090848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c619501a32ee45eda23bf0a62185ed21'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.091354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c619501a32ee45eda23bf0a62185ed21'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.104050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c619501a32ee45eda23bf0a62185ed21'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.104831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c619501a32ee45eda23bf0a62185ed21'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.123224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 877/1782] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:28 2022] DELETE /identity/v3/users/c619501a32ee45eda23bf0a62185ed21 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:29.131632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de754bd6-50e1-49c2-9974-65eedc2057d0 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.193086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65988aa-5da5-47dc-bc20-f58ca7ba20b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.193716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988aa-5da5-47dc-bc20-f58ca7ba20b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.193997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988aa-5da5-47dc-bc20-f58ca7ba20b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.194593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988aa-5da5-47dc-bc20-f58ca7ba20b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.194921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65988aa-5da5-47dc-bc20-f58ca7ba20b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.197483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65988aa-5da5-47dc-bc20-f58ca7ba20b7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.224245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 906/1783] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:29 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:29.228220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.230366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:29.246023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6f194-63c4-499b-8ae8-4d9b836be1e1 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.253140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bd0dd-0c56-49ba-b520-1809ba59d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.253899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd0dd-0c56-49ba-b520-1809ba59d4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.254265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd0dd-0c56-49ba-b520-1809ba59d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.254637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd0dd-0c56-49ba-b520-1809ba59d4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.255484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bd0dd-0c56-49ba-b520-1809ba59d4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.257175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bd0dd-0c56-49ba-b520-1809ba59d4d2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.272136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 878/1784] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:29.274835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65988aa-5da5-47dc-bc20-f58ca7ba20b7 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.290304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65988aa-5da5-47dc-bc20-f58ca7ba20b7 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.304519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba5556-0dc8-4b30-a93e-ee9a952be7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.304778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba5556-0dc8-4b30-a93e-ee9a952be7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.305169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba5556-0dc8-4b30-a93e-ee9a952be7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.305451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba5556-0dc8-4b30-a93e-ee9a952be7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.306922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba5556-0dc8-4b30-a93e-ee9a952be7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.308855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba5556-0dc8-4b30-a93e-ee9a952be7c7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.323031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 907/1785] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:29.325644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bd0dd-0c56-49ba-b520-1809ba59d4d2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.336360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bd0dd-0c56-49ba-b520-1809ba59d4d2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.341607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.342359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.342742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.343216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] PATH_INFO: `/v3/projects/f5d4b34d7b9247b8958a3c17b0be9012/users/db5d087eba854117a150845090d1c2b1/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.360544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d4b34d7b9247b8958a3c17b0be9012, user_id=db5d087eba854117a150845090d1c2b1, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.363347 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.382227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 879/1786] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:29 2022] PUT /identity/v3/projects/f5d4b34d7b9247b8958a3c17b0be9012/users/db5d087eba854117a150845090d1c2b1/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:29.394262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92f773-d44f-488f-8003-485be1973986 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.394557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92f773-d44f-488f-8003-485be1973986 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.394831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92f773-d44f-488f-8003-485be1973986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.434207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9a92f773-d44f-488f-8003-485be1973986 None None] MFA Rules not processed for user `db5d087eba854117a150845090d1c2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:29.435028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9a92f773-d44f-488f-8003-485be1973986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:29.497685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.499452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:29.531325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 908/1787] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:29.558546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92f773-d44f-488f-8003-485be1973986 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.564164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9a92f773-d44f-488f-8003-485be1973986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:29.598045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:29.601874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b176ac1-51a6-46eb-99df-e4938b206601 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.608566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.609546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.609946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.610170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] PATH_INFO: `/v3/projects/06a09c9e4f024a21bf5dd1a8559832f5` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.611733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a09c9e4f024a21bf5dd1a8559832f5)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.614009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.614557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:29.643875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92f773-d44f-488f-8003-485be1973986 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.659380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69ce59-21a3-4c14-8acf-f0e44f7daf79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.660019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ce59-21a3-4c14-8acf-f0e44f7daf79 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.660302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ce59-21a3-4c14-8acf-f0e44f7daf79 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.660569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ce59-21a3-4c14-8acf-f0e44f7daf79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.668381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a09c9e4f024a21bf5dd1a8559832f5', 'request_id': 'req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.669802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ce59-21a3-4c14-8acf-f0e44f7daf79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.671453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ce59-21a3-4c14-8acf-f0e44f7daf79 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.674543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a09c9e4f024a21bf5dd1a8559832f5', 'request_id': 'req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.682294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 909/1788] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:29.683147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a09c9e4f024a21bf5dd1a8559832f5', 'request_id': 'req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.693666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] The token cache is being invalidate because project 06a09c9e4f024a21bf5dd1a8559832f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:29.693953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.694624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0cff6ad0-25e4-4c9a-a95b-165cba8c17d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.696216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 880/1789] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:29 2022] DELETE /identity/v3/projects/06a09c9e4f024a21bf5dd1a8559832f5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:29.701136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805c1db-088e-4761-87e6-b6fc72cfb223 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.701425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805c1db-088e-4761-87e6-b6fc72cfb223 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.701702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805c1db-088e-4761-87e6-b6fc72cfb223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.724586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5805c1db-088e-4761-87e6-b6fc72cfb223 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:29.724586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5805c1db-088e-4761-87e6-b6fc72cfb223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:29.792806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 910/1790] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:29.801459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aae99-9c42-44e3-9518-540bdc26abc8 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.801954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aae99-9c42-44e3-9518-540bdc26abc8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.802039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aae99-9c42-44e3-9518-540bdc26abc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.828340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-400aae99-9c42-44e3-9518-540bdc26abc8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:29.829521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-400aae99-9c42-44e3-9518-540bdc26abc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:29.849228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 881/1791] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:29.855762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805c1db-088e-4761-87e6-b6fc72cfb223 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.864982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805c1db-088e-4761-87e6-b6fc72cfb223 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.869669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.870286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.870566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.870841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.871591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:29.871897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.873492 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.886120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 911/1792] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:52:29.890607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aae99-9c42-44e3-9518-540bdc26abc8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.903936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aae99-9c42-44e3-9518-540bdc26abc8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.908289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7054fc-f470-47fa-9945-ad6d78a34a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.908915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7054fc-f470-47fa-9945-ad6d78a34a9f admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.909198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7054fc-f470-47fa-9945-ad6d78a34a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.909475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7054fc-f470-47fa-9945-ad6d78a34a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.910404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7054fc-f470-47fa-9945-ad6d78a34a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.910815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.912351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7054fc-f470-47fa-9945-ad6d78a34a9f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.912715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:29.926219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6fb29-4b54-4b65-986a-a21d52c428a3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:29.931187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:29.932003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:29.932326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:29.932677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] PATH_INFO: `/v3/users/db5d087eba854117a150845090d1c2b1` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:29.934110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5d087eba854117a150845090d1c2b1)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:29.936148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:29.942956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 882/1793] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:29 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:29.946442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7054fc-f470-47fa-9945-ad6d78a34a9f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:29.987644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5d087eba854117a150845090d1c2b1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:29.995660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5d087eba854117a150845090d1c2b1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.003079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5d087eba854117a150845090d1c2b1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.003879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5d087eba854117a150845090d1c2b1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.008142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7054fc-f470-47fa-9945-ad6d78a34a9f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:30.013047 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:30.013662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.013941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.014228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.014876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:30.016366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6096f067-5c34-4ef0-9d41-ef88ff015c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5d087eba854117a150845090d1c2b1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.016891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:30.022558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 912/1794] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:29 2022] DELETE /identity/v3/users/db5d087eba854117a150845090d1c2b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:30.027853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef1fd5-7b67-47d9-9aef-9bcad1792464 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.028130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef1fd5-7b67-47d9-9aef-9bcad1792464 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.028412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef1fd5-7b67-47d9-9aef-9bcad1792464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.040991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 883/1795] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:29 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:30.046081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:30.047986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:30.050517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-2eef1fd5-7b67-47d9-9aef-9bcad1792464 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:30.051731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2eef1fd5-7b67-47d9-9aef-9bcad1792464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:30.060056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51778aa7-0314-4a47-852d-72b1235dc7d6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:30.078333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:30.107599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:30.122270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef3a86-fd3e-4f30-8938-e6d566c32e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:30.122900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef3a86-fd3e-4f30-8938-e6d566c32e8d admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.123219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef3a86-fd3e-4f30-8938-e6d566c32e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.123614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef3a86-fd3e-4f30-8938-e6d566c32e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.124349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef3a86-fd3e-4f30-8938-e6d566c32e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:30.126034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef3a86-fd3e-4f30-8938-e6d566c32e8d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:30.132291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 913/1796] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:30.137359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 884/1797] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:30.141414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef3a86-fd3e-4f30-8938-e6d566c32e8d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:30.141544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef1fd5-7b67-47d9-9aef-9bcad1792464 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:30.142956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2eef1fd5-7b67-47d9-9aef-9bcad1792464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:30.152857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef3a86-fd3e-4f30-8938-e6d566c32e8d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:30.157847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0c9ad-7929-43be-abb4-b3bb3dddb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:30.158613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0c9ad-7929-43be-abb4-b3bb3dddb601 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.158954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0c9ad-7929-43be-abb4-b3bb3dddb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.159329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0c9ad-7929-43be-abb4-b3bb3dddb601 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.160500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0c9ad-7929-43be-abb4-b3bb3dddb601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:30.162175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0c9ad-7929-43be-abb4-b3bb3dddb601 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:30.177863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 885/1798] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:30.179074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0c9ad-7929-43be-abb4-b3bb3dddb601 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:30.190500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0c9ad-7929-43be-abb4-b3bb3dddb601 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:30.195497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f33a5-14af-4c9d-9744-2d1ac9ed65bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:30.196262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f33a5-14af-4c9d-9744-2d1ac9ed65bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.197270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f33a5-14af-4c9d-9744-2d1ac9ed65bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.197393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f33a5-14af-4c9d-9744-2d1ac9ed65bc admin admin] PATH_INFO: `/v3/projects/5eb2f2e5b85a4c568ebb121ba5d9a471/users/7033eadc41354e6cb2f187fa113b3af9/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.210351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef1fd5-7b67-47d9-9aef-9bcad1792464 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:30.211554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:30.212848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.213196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.213566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.216642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f33a5-14af-4c9d-9744-2d1ac9ed65bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb2f2e5b85a4c568ebb121ba5d9a471, user_id=7033eadc41354e6cb2f187fa113b3af9, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:30.219912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f33a5-14af-4c9d-9744-2d1ac9ed65bc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:30.223516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:30.225135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:30.235621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 886/1799] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:30 2022] PUT /identity/v3/projects/5eb2f2e5b85a4c568ebb121ba5d9a471/users/7033eadc41354e6cb2f187fa113b3af9/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:30.236387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 914/1800] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:30.246876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec437-c323-4b22-a4f3-ab349d198006 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.247449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec437-c323-4b22-a4f3-ab349d198006 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.247872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec437-c323-4b22-a4f3-ab349d198006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.285361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-497ec437-c323-4b22-a4f3-ab349d198006 None None] MFA Rules not processed for user `7033eadc41354e6cb2f187fa113b3af9`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:30.286920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-497ec437-c323-4b22-a4f3-ab349d198006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:30.411181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 887/1801] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:30.427120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:30.429121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:30.523531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdbf59-5183-42aa-94c7-a7cbf31635d3 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:30.595439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:30.596212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.596511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.596790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.608265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:30.609198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:30.629909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 915/1802] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:30.668095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ec437-c323-4b22-a4f3-ab349d198006 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:30.750273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ec437-c323-4b22-a4f3-ab349d198006 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:30.755411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:30.756165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.756484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.756748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] PATH_INFO: `/v3/users/7033eadc41354e6cb2f187fa113b3af9` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.757682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:30.758053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7033eadc41354e6cb2f187fa113b3af9)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:30.760437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:30.760549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:30.789491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa791aa-d602-48c2-94d4-54e885765a24 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:30.796744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:30.797478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.797760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.798122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] PATH_INFO: `/v3/projects/f5d4b34d7b9247b8958a3c17b0be9012` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.799519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d4b34d7b9247b8958a3c17b0be9012)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:30.801596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:30.814640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:30.823361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7033eadc41354e6cb2f187fa113b3af9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.831933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7033eadc41354e6cb2f187fa113b3af9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.832655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7033eadc41354e6cb2f187fa113b3af9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.843980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:30.874520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7033eadc41354e6cb2f187fa113b3af9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.875789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ee613ae2-23f2-4789-93b3-fa5dbc473943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7033eadc41354e6cb2f187fa113b3af9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.890127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d4b34d7b9247b8958a3c17b0be9012', 'request_id': 'req-7778e75a-42fa-40ab-abf1-f4a9bd202865'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.899569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 888/1803] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:30 2022] DELETE /identity/v3/users/7033eadc41354e6cb2f187fa113b3af9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:30.906468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe570-7985-4ca8-ba81-0a5d9c436b78 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.906848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe570-7985-4ca8-ba81-0a5d9c436b78 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.907207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe570-7985-4ca8-ba81-0a5d9c436b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.927541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d4b34d7b9247b8958a3c17b0be9012', 'request_id': 'req-7778e75a-42fa-40ab-abf1-f4a9bd202865'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.934903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d4b34d7b9247b8958a3c17b0be9012', 'request_id': 'req-7778e75a-42fa-40ab-abf1-f4a9bd202865'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.955131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] The token cache is being invalidate because project f5d4b34d7b9247b8958a3c17b0be9012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:30.955514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.956101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7778e75a-42fa-40ab-abf1-f4a9bd202865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:30.957369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-77cfe570-7985-4ca8-ba81-0a5d9c436b78 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:30.958904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-77cfe570-7985-4ca8-ba81-0a5d9c436b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:30.961050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 916/1804] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:30 2022] DELETE /identity/v3/projects/f5d4b34d7b9247b8958a3c17b0be9012 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:30.966569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da624ebb-643b-4ded-8cf9-3f18f1d57d56 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:30.966866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da624ebb-643b-4ded-8cf9-3f18f1d57d56 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:30.967270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da624ebb-643b-4ded-8cf9-3f18f1d57d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:30.991119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-da624ebb-643b-4ded-8cf9-3f18f1d57d56 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:30.992360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-da624ebb-643b-4ded-8cf9-3f18f1d57d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:31.070129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 889/1805] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:31.081199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe570-7985-4ca8-ba81-0a5d9c436b78 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.082780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-77cfe570-7985-4ca8-ba81-0a5d9c436b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:31.086637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 917/1806] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:31.094954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f8384-ed2e-4007-839c-9fef16350e1c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.095674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f8384-ed2e-4007-839c-9fef16350e1c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.096208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f8384-ed2e-4007-839c-9fef16350e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.117462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-2d4f8384-ed2e-4007-839c-9fef16350e1c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:31.119274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2d4f8384-ed2e-4007-839c-9fef16350e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:31.133803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 918/1807] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:31.139929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f8384-ed2e-4007-839c-9fef16350e1c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.150337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f8384-ed2e-4007-839c-9fef16350e1c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.154881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.155601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.155880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.156152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.156897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:31.157184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.158771 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.161171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe570-7985-4ca8-ba81-0a5d9c436b78 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.164765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64a889-8e14-4334-84ae-624bed33b99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.165498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64a889-8e14-4334-84ae-624bed33b99b service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.165869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64a889-8e14-4334-84ae-624bed33b99b service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.166208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64a889-8e14-4334-84ae-624bed33b99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.174419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 919/1808] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:52:31.175902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.178361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64a889-8e14-4334-84ae-624bed33b99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.180077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64a889-8e14-4334-84ae-624bed33b99b service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.191258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 890/1809] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:31.197295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf26f1-f76c-42e1-9de0-1dc82fbbfc0e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.202956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c8420-15e6-4de8-ae76-7e4d9c79c626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.203804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8420-15e6-4de8-ae76-7e4d9c79c626 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.204123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8420-15e6-4de8-ae76-7e4d9c79c626 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.204401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8420-15e6-4de8-ae76-7e4d9c79c626 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.205193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c8420-15e6-4de8-ae76-7e4d9c79c626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.207156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c8420-15e6-4de8-ae76-7e4d9c79c626 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.273781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 920/1810] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:31 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:31.277650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64a889-8e14-4334-84ae-624bed33b99b service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.287503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64a889-8e14-4334-84ae-624bed33b99b service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.359170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe094b-15f1-4f2e-a503-ab35c90961d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.359865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe094b-15f1-4f2e-a503-ab35c90961d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.360145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe094b-15f1-4f2e-a503-ab35c90961d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.360418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe094b-15f1-4f2e-a503-ab35c90961d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.361106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe094b-15f1-4f2e-a503-ab35c90961d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.363159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe094b-15f1-4f2e-a503-ab35c90961d9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.391253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:31.419655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 891/1811] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:31 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:31.420157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c8420-15e6-4de8-ae76-7e4d9c79c626 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.441016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c8420-15e6-4de8-ae76-7e4d9c79c626 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.467770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6549-df8e-45d2-b375-cb4bcf2bb277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.468609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6549-df8e-45d2-b375-cb4bcf2bb277 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.468901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6549-df8e-45d2-b375-cb4bcf2bb277 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.469183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef6549-df8e-45d2-b375-cb4bcf2bb277 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.469901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef6549-df8e-45d2-b375-cb4bcf2bb277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.471582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef6549-df8e-45d2-b375-cb4bcf2bb277 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.488562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 921/1812] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:31.492685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe094b-15f1-4f2e-a503-ab35c90961d9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.505767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe094b-15f1-4f2e-a503-ab35c90961d9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.523659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbb736-0033-4bb8-aca0-23389cc9a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.524574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb736-0033-4bb8-aca0-23389cc9a2fe admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.525011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb736-0033-4bb8-aca0-23389cc9a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.525393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb736-0033-4bb8-aca0-23389cc9a2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.526329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbb736-0033-4bb8-aca0-23389cc9a2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.530701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbb736-0033-4bb8-aca0-23389cc9a2fe admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.582763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 892/1813] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:31.584554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6549-df8e-45d2-b375-cb4bcf2bb277 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.598022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef6549-df8e-45d2-b375-cb4bcf2bb277 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.605822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.607609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.608723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.609615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] PATH_INFO: `/v3/projects/1f74613ba961436f9b2886fdb9cfd18a/users/553664767fbe4e71aeea5f46ed7559c4/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.650354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f74613ba961436f9b2886fdb9cfd18a, user_id=553664767fbe4e71aeea5f46ed7559c4, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.653242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.681829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 922/1814] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:31 2022] PUT /identity/v3/projects/1f74613ba961436f9b2886fdb9cfd18a/users/553664767fbe4e71aeea5f46ed7559c4/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:31.684225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee1a3-c56c-463a-962a-bcfbd3e19fd7 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.684521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee1a3-c56c-463a-962a-bcfbd3e19fd7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.684875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee1a3-c56c-463a-962a-bcfbd3e19fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.740685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ce9ee1a3-c56c-463a-962a-bcfbd3e19fd7 None None] MFA Rules not processed for user `553664767fbe4e71aeea5f46ed7559c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:31.742878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ce9ee1a3-c56c-463a-962a-bcfbd3e19fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:31.769872 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.771925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:31.837848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:31.874171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c65f-14c6-4069-956c-4e82b79a5cd0 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.874549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 893/1815] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:31.878516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ee1a3-c56c-463a-962a-bcfbd3e19fd7 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.882861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.883699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.884093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.884440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] PATH_INFO: `/v3/projects/5eb2f2e5b85a4c568ebb121ba5d9a471` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.885690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb2f2e5b85a4c568ebb121ba5d9a471)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.887960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.889723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ee1a3-c56c-463a-962a-bcfbd3e19fd7 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:31.894611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a97b-c7d0-40b6-8c16-80fd560ecae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:31.895259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a97b-c7d0-40b6-8c16-80fd560ecae0 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:31.895546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a97b-c7d0-40b6-8c16-80fd560ecae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:31.895819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a97b-c7d0-40b6-8c16-80fd560ecae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:31.896483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a97b-c7d0-40b6-8c16-80fd560ecae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:31.898365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a97b-c7d0-40b6-8c16-80fd560ecae0 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:31.932078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 894/1816] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:31 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:31.935646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a97b-c7d0-40b6-8c16-80fd560ecae0 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:31.961160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb2f2e5b85a4c568ebb121ba5d9a471', 'request_id': 'req-da2874c6-f413-4330-b3ef-cc69dcfcca89'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:31.979022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb2f2e5b85a4c568ebb121ba5d9a471', 'request_id': 'req-da2874c6-f413-4330-b3ef-cc69dcfcca89'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:31.986053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb2f2e5b85a4c568ebb121ba5d9a471', 'request_id': 'req-da2874c6-f413-4330-b3ef-cc69dcfcca89'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:31.999636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] The token cache is being invalidate because project 5eb2f2e5b85a4c568ebb121ba5d9a471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:32.000270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:32.000860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-da2874c6-f413-4330-b3ef-cc69dcfcca89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:32.003172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 923/1817] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:31 2022] DELETE /identity/v3/projects/5eb2f2e5b85a4c568ebb121ba5d9a471 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:32.007944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85d75-8509-4ea3-859b-5a145c50374b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.008126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85d75-8509-4ea3-859b-5a145c50374b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.008402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85d75-8509-4ea3-859b-5a145c50374b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.017976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a97b-c7d0-40b6-8c16-80fd560ecae0 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.023002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.023633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.023921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.024194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.025832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.027803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.030471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-75f85d75-8509-4ea3-859b-5a145c50374b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:32.031741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-75f85d75-8509-4ea3-859b-5a145c50374b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:32.039753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 924/1818] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:32.048747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaae0b6-3e11-413b-a22d-a97789281b47 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.049043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaae0b6-3e11-413b-a22d-a97789281b47 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.049325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaae0b6-3e11-413b-a22d-a97789281b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.053927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 895/1819] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:31 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:32.054960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.056623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:32.068405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc205e0-acee-4a29-8da9-e43984287471 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.068921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-faaae0b6-3e11-413b-a22d-a97789281b47 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:32.070154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-faaae0b6-3e11-413b-a22d-a97789281b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:32.073072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f70e5-210d-4d60-92a3-a4f46f77bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.073680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f70e5-210d-4d60-92a3-a4f46f77bf41 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.073960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f70e5-210d-4d60-92a3-a4f46f77bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.074233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f70e5-210d-4d60-92a3-a4f46f77bf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.074937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f70e5-210d-4d60-92a3-a4f46f77bf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.076533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f70e5-210d-4d60-92a3-a4f46f77bf41 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.079087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 925/1820] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:32.082566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaae0b6-3e11-413b-a22d-a97789281b47 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.090437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 896/1821] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:32.091456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f70e5-210d-4d60-92a3-a4f46f77bf41 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.092590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaae0b6-3e11-413b-a22d-a97789281b47 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.097452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.098055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.098336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.098611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.099422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:32.099738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.100968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f70e5-210d-4d60-92a3-a4f46f77bf41 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.101321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.106347 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb298f-84d9-4322-939c-fb712ce6d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.107067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb298f-84d9-4322-939c-fb712ce6d07b admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.107353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb298f-84d9-4322-939c-fb712ce6d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.107635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb298f-84d9-4322-939c-fb712ce6d07b admin admin] PATH_INFO: `/v3/projects/20b62e13f66c4a8aae066e26cc0fbff6/users/1ada29f540274d82a01b673d48ac04f2/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.113621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 926/1822] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:52:32.117729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.122744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb298f-84d9-4322-939c-fb712ce6d07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b62e13f66c4a8aae066e26cc0fbff6, user_id=1ada29f540274d82a01b673d48ac04f2, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.125761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb298f-84d9-4322-939c-fb712ce6d07b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.127061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830192b8-8d39-4122-91ed-b58afebd361f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.131875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814533-daa2-413e-852c-7920e7a2c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.132459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814533-daa2-413e-852c-7920e7a2c1de admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.132742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814533-daa2-413e-852c-7920e7a2c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.133015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814533-daa2-413e-852c-7920e7a2c1de admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.133672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814533-daa2-413e-852c-7920e7a2c1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.135740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814533-daa2-413e-852c-7920e7a2c1de admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.140313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 897/1823] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:32 2022] PUT /identity/v3/projects/20b62e13f66c4a8aae066e26cc0fbff6/users/1ada29f540274d82a01b673d48ac04f2/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:32.144096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb298f-84d9-4322-939c-fb712ce6d07b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.150550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:32.166830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 927/1824] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:32 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:32.170703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814533-daa2-413e-852c-7920e7a2c1de admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.210047 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb298f-84d9-4322-939c-fb712ce6d07b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.232658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814533-daa2-413e-852c-7920e7a2c1de admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.237354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646d75-1be2-4f8c-8a3a-95aeda0b0498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.237962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646d75-1be2-4f8c-8a3a-95aeda0b0498 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.238240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646d75-1be2-4f8c-8a3a-95aeda0b0498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.238512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646d75-1be2-4f8c-8a3a-95aeda0b0498 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.239202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646d75-1be2-4f8c-8a3a-95aeda0b0498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.241230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646d75-1be2-4f8c-8a3a-95aeda0b0498 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.269068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 928/1825] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:32 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:32.270340 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646d75-1be2-4f8c-8a3a-95aeda0b0498 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.275096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1a7c7-ed53-43ce-9e88-12f0b305e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.275724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a7c7-ed53-43ce-9e88-12f0b305e369 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.276007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a7c7-ed53-43ce-9e88-12f0b305e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.276484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a7c7-ed53-43ce-9e88-12f0b305e369 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.277192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1a7c7-ed53-43ce-9e88-12f0b305e369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.279432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1a7c7-ed53-43ce-9e88-12f0b305e369 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.282142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646d75-1be2-4f8c-8a3a-95aeda0b0498 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.287076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef1d1d-7e78-4464-a458-26c0fb6c64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.287719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef1d1d-7e78-4464-a458-26c0fb6c64ff admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.287984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef1d1d-7e78-4464-a458-26c0fb6c64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.288339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef1d1d-7e78-4464-a458-26c0fb6c64ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.290176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef1d1d-7e78-4464-a458-26c0fb6c64ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.294994 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef1d1d-7e78-4464-a458-26c0fb6c64ff admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.295148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 898/1826] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:32.296588 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1a7c7-ed53-43ce-9e88-12f0b305e369 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.299499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:32.308420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 929/1827] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:32.309108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1a7c7-ed53-43ce-9e88-12f0b305e369 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.309534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef1d1d-7e78-4464-a458-26c0fb6c64ff admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.314598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6665068-0011-439c-987e-467ef668e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.315873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665068-0011-439c-987e-467ef668e8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.316172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665068-0011-439c-987e-467ef668e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.316587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665068-0011-439c-987e-467ef668e8a5 admin admin] PATH_INFO: `/v3/projects/20b62e13f66c4a8aae066e26cc0fbff6/users/1ada29f540274d82a01b673d48ac04f2/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.320001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6665068-0011-439c-987e-467ef668e8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b62e13f66c4a8aae066e26cc0fbff6, user_id=1ada29f540274d82a01b673d48ac04f2, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.322035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef1d1d-7e78-4464-a458-26c0fb6c64ff admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.323514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6665068-0011-439c-987e-467ef668e8a5 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.327159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ba91-92aa-463f-9890-6973c35dd80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.328120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ba91-92aa-463f-9890-6973c35dd80e admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.328540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ba91-92aa-463f-9890-6973c35dd80e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.328855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ba91-92aa-463f-9890-6973c35dd80e admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.329726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9ba91-92aa-463f-9890-6973c35dd80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.331497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9ba91-92aa-463f-9890-6973c35dd80e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.335969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 899/1828] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:32 2022] PUT /identity/v3/projects/20b62e13f66c4a8aae066e26cc0fbff6/users/1ada29f540274d82a01b673d48ac04f2/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:32.345480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 930/1829] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:32.347333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e9c8-c415-4dc9-9b87-f83245e065a5 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.347678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e9c8-c415-4dc9-9b87-f83245e065a5 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.348013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e9c8-c415-4dc9-9b87-f83245e065a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.349463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ba91-92aa-463f-9890-6973c35dd80e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.366027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ba91-92aa-463f-9890-6973c35dd80e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.380869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-da39e9c8-c415-4dc9-9b87-f83245e065a5 None None] MFA Rules not processed for user `1ada29f540274d82a01b673d48ac04f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:32.382222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-da39e9c8-c415-4dc9-9b87-f83245e065a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:32.437523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecfbed-ddc4-4779-8ca6-ac225b2165ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.438911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecfbed-ddc4-4779-8ca6-ac225b2165ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.439427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecfbed-ddc4-4779-8ca6-ac225b2165ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.439857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecfbed-ddc4-4779-8ca6-ac225b2165ab admin admin] PATH_INFO: `/v3/projects/7296ca4094044d4084681d4dda108654/users/55399fe911cd4247a6dda645ae903a4d/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.462050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecfbed-ddc4-4779-8ca6-ac225b2165ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7296ca4094044d4084681d4dda108654, user_id=55399fe911cd4247a6dda645ae903a4d, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.465258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecfbed-ddc4-4779-8ca6-ac225b2165ab admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.475927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 900/1830] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:32.492399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e9c8-c415-4dc9-9b87-f83245e065a5 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.493852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-da39e9c8-c415-4dc9-9b87-f83245e065a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:32.494258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 931/1831] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:32 2022] PUT /identity/v3/projects/7296ca4094044d4084681d4dda108654/users/55399fe911cd4247a6dda645ae903a4d/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:32.505337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334bb6-409b-4e7b-ba9f-aed61e309639 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.505621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334bb6-409b-4e7b-ba9f-aed61e309639 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.505895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334bb6-409b-4e7b-ba9f-aed61e309639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.518343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:32.536780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-48334bb6-409b-4e7b-ba9f-aed61e309639 None None] MFA Rules not processed for user `55399fe911cd4247a6dda645ae903a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:32.537995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-48334bb6-409b-4e7b-ba9f-aed61e309639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:32.581122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e9c8-c415-4dc9-9b87-f83245e065a5 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.637934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 932/1832] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:32.657209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48334bb6-409b-4e7b-ba9f-aed61e309639 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.658831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-48334bb6-409b-4e7b-ba9f-aed61e309639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:32.664995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41327c-ee27-4918-b480-8a7fcc90079d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.665899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41327c-ee27-4918-b480-8a7fcc90079d service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.666279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41327c-ee27-4918-b480-8a7fcc90079d service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.666677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41327c-ee27-4918-b480-8a7fcc90079d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.673974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48334bb6-409b-4e7b-ba9f-aed61e309639 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.677790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e4e0-577a-4d89-8456-a41386aa9377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.678409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e4e0-577a-4d89-8456-a41386aa9377 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.678705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e4e0-577a-4d89-8456-a41386aa9377 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.678982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e4e0-577a-4d89-8456-a41386aa9377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.688001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e4e0-577a-4d89-8456-a41386aa9377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.689658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e4e0-577a-4d89-8456-a41386aa9377 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.715342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 933/1833] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:32.723866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e4e0-577a-4d89-8456-a41386aa9377 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.747914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41327c-ee27-4918-b480-8a7fcc90079d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.750737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41327c-ee27-4918-b480-8a7fcc90079d service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.764627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 901/1834] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:32.809807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:32.828593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e4e0-577a-4d89-8456-a41386aa9377 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.834019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.834888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.835209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.835575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] PATH_INFO: `/v3/users/55399fe911cd4247a6dda645ae903a4d` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.836834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55399fe911cd4247a6dda645ae903a4d)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:32.839511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:32.902565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41327c-ee27-4918-b480-8a7fcc90079d service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:32.912199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41327c-ee27-4918-b480-8a7fcc90079d service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:32.928950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:32.929898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:32.930367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:32.930553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:32.933644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:32.938226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55399fe911cd4247a6dda645ae903a4d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:32.948729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55399fe911cd4247a6dda645ae903a4d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:32.959879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55399fe911cd4247a6dda645ae903a4d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:32.960952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55399fe911cd4247a6dda645ae903a4d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:32.992956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a54ce26a-9e32-4a61-a57b-1ebe310daae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55399fe911cd4247a6dda645ae903a4d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:33.000706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 934/1835] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:32 2022] DELETE /identity/v3/users/55399fe911cd4247a6dda645ae903a4d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:33.006693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829fa57-e59e-48b8-8f0e-43074d26ff34 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.009674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829fa57-e59e-48b8-8f0e-43074d26ff34 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.009978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829fa57-e59e-48b8-8f0e-43074d26ff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.044996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-0829fa57-e59e-48b8-8f0e-43074d26ff34 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:33.046585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0829fa57-e59e-48b8-8f0e-43074d26ff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:33.063904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:33.065524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:33.077792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 902/1836] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:33.133525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 935/1837] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:33.144280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:33.146123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:33.176555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:33.214337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f66a45-d04a-43ba-9e2b-5182ec6a3be4 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:33.278278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6df9a9-56a5-4fd0-8284-d275e22fb01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:33.278915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6df9a9-56a5-4fd0-8284-d275e22fb01e service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.279259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6df9a9-56a5-4fd0-8284-d275e22fb01e service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.279607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6df9a9-56a5-4fd0-8284-d275e22fb01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.288904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6df9a9-56a5-4fd0-8284-d275e22fb01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:33.290856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6df9a9-56a5-4fd0-8284-d275e22fb01e service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:33.300283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 903/1838] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:33.554762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829fa57-e59e-48b8-8f0e-43074d26ff34 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:33.556731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0829fa57-e59e-48b8-8f0e-43074d26ff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:33.572889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829fa57-e59e-48b8-8f0e-43074d26ff34 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:33.577760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:33.578444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.578681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.578993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] PATH_INFO: `/v3/projects/7296ca4094044d4084681d4dda108654` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.580177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7296ca4094044d4084681d4dda108654)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:33.582125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:33.630178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7296ca4094044d4084681d4dda108654', 'request_id': 'req-3f16b7de-5005-4a0e-a206-f0ba37a798a1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:33.638310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7296ca4094044d4084681d4dda108654', 'request_id': 'req-3f16b7de-5005-4a0e-a206-f0ba37a798a1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:33.643326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:33.644996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7296ca4094044d4084681d4dda108654', 'request_id': 'req-3f16b7de-5005-4a0e-a206-f0ba37a798a1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:33.660138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] The token cache is being invalidate because project 7296ca4094044d4084681d4dda108654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:33.660429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:33.661085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3f16b7de-5005-4a0e-a206-f0ba37a798a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:33.662644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 936/1839] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:33 2022] DELETE /identity/v3/projects/7296ca4094044d4084681d4dda108654 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:33.668163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48114ac8-ef9b-407a-8ab6-2e293a3b06dd None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.668452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48114ac8-ef9b-407a-8ab6-2e293a3b06dd None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.668731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48114ac8-ef9b-407a-8ab6-2e293a3b06dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.687933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-48114ac8-ef9b-407a-8ab6-2e293a3b06dd None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:33.689145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-48114ac8-ef9b-407a-8ab6-2e293a3b06dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:33.747072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 904/1840] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:33.754544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95c62-2b1d-42dd-acd3-27bcc0af2680 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.754830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95c62-2b1d-42dd-acd3-27bcc0af2680 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.755140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95c62-2b1d-42dd-acd3-27bcc0af2680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.775159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3db95c62-2b1d-42dd-acd3-27bcc0af2680 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:33.776348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3db95c62-2b1d-42dd-acd3-27bcc0af2680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:33.784023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 937/1841] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:33.787967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48114ac8-ef9b-407a-8ab6-2e293a3b06dd None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:33.798166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48114ac8-ef9b-407a-8ab6-2e293a3b06dd None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:33.802759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:33.803403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.803691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.803968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.804662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:33.804971 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:33.806632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:33.818178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 905/1842] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:33.822690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db95c62-2b1d-42dd-acd3-27bcc0af2680 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:33.831904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db95c62-2b1d-42dd-acd3-27bcc0af2680 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:33.836824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba79390-1f03-48dd-b0da-780a947d6a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:33.837969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79390-1f03-48dd-b0da-780a947d6a3c admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.838251 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79390-1f03-48dd-b0da-780a947d6a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.838524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba79390-1f03-48dd-b0da-780a947d6a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.839296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba79390-1f03-48dd-b0da-780a947d6a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:33.841238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba79390-1f03-48dd-b0da-780a947d6a3c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:33.870202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 938/1843] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:33 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:33.874504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:33.884772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8b15-4312-438b-8a98-61536154892d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:33.940731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880f15-2f71-4b84-a597-e2d971f6daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:33.941246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880f15-2f71-4b84-a597-e2d971f6daa8 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.941512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880f15-2f71-4b84-a597-e2d971f6daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.941973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880f15-2f71-4b84-a597-e2d971f6daa8 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.942689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880f15-2f71-4b84-a597-e2d971f6daa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:33.944657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880f15-2f71-4b84-a597-e2d971f6daa8 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:33.961792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:33.971221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 906/1844] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:33 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:33.973517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba79390-1f03-48dd-b0da-780a947d6a3c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:33.984193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba79390-1f03-48dd-b0da-780a947d6a3c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:33.988804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ab09-4bd3-41f1-92fe-294f409bae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:33.989423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ab09-4bd3-41f1-92fe-294f409bae2b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:33.989707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ab09-4bd3-41f1-92fe-294f409bae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:33.989978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709ab09-4bd3-41f1-92fe-294f409bae2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:33.990712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709ab09-4bd3-41f1-92fe-294f409bae2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:33.992338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709ab09-4bd3-41f1-92fe-294f409bae2b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.002615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 939/1845] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:34.006408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880f15-2f71-4b84-a597-e2d971f6daa8 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.017071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880f15-2f71-4b84-a597-e2d971f6daa8 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.021759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76097c22-cdf0-4b7c-ab2a-4944362e37bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.022424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097c22-cdf0-4b7c-ab2a-4944362e37bf admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.022706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097c22-cdf0-4b7c-ab2a-4944362e37bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.023063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097c22-cdf0-4b7c-ab2a-4944362e37bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.023786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76097c22-cdf0-4b7c-ab2a-4944362e37bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.025962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76097c22-cdf0-4b7c-ab2a-4944362e37bf admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.036432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 907/1846] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:34.040802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ab09-4bd3-41f1-92fe-294f409bae2b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.051295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709ab09-4bd3-41f1-92fe-294f409bae2b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.056174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d62a42-642e-4c09-b5fa-5232d44f6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.056837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62a42-642e-4c09-b5fa-5232d44f6dba admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.057115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62a42-642e-4c09-b5fa-5232d44f6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.057392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62a42-642e-4c09-b5fa-5232d44f6dba admin admin] PATH_INFO: `/v3/projects/2893db43cc8540c199c0a6005a508787/users/5c6339e860894a8a843b0e34394b2c85/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.074310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d62a42-642e-4c09-b5fa-5232d44f6dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2893db43cc8540c199c0a6005a508787, user_id=5c6339e860894a8a843b0e34394b2c85, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.076979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d62a42-642e-4c09-b5fa-5232d44f6dba admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.098720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 940/1847] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:34 2022] PUT /identity/v3/projects/2893db43cc8540c199c0a6005a508787/users/5c6339e860894a8a843b0e34394b2c85/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:34.109255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d541c-28e3-464e-bfee-3a4e804b4b24 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.109557 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d541c-28e3-464e-bfee-3a4e804b4b24 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.109810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d541c-28e3-464e-bfee-3a4e804b4b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.146291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ca3d541c-28e3-464e-bfee-3a4e804b4b24 None None] MFA Rules not processed for user `5c6339e860894a8a843b0e34394b2c85`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:34.147739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ca3d541c-28e3-464e-bfee-3a4e804b4b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:34.215728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 908/1848] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:34.220224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d62a42-642e-4c09-b5fa-5232d44f6dba admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.290469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d62a42-642e-4c09-b5fa-5232d44f6dba admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.295822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a3045-1d4b-4087-ba3b-7947e611dfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.296573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3045-1d4b-4087-ba3b-7947e611dfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.296958 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3045-1d4b-4087-ba3b-7947e611dfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.297336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a3045-1d4b-4087-ba3b-7947e611dfa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.298249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a3045-1d4b-4087-ba3b-7947e611dfa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.300292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a3045-1d4b-4087-ba3b-7947e611dfa3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.332387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 941/1849] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:34 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:34.336295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d541c-28e3-464e-bfee-3a4e804b4b24 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.348082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d541c-28e3-464e-bfee-3a4e804b4b24 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.411516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ac47d-5041-4c3b-9d34-bd4e42ce2fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.412478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ac47d-5041-4c3b-9d34-bd4e42ce2fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.412761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ac47d-5041-4c3b-9d34-bd4e42ce2fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.413044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ac47d-5041-4c3b-9d34-bd4e42ce2fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.413717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ac47d-5041-4c3b-9d34-bd4e42ce2fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.415846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ac47d-5041-4c3b-9d34-bd4e42ce2fc9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.451207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 909/1850] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:34 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:34.453182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a3045-1d4b-4087-ba3b-7947e611dfa3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.464432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a3045-1d4b-4087-ba3b-7947e611dfa3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.469038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee89e-5951-4e51-82cc-e55a59aefdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.469654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee89e-5951-4e51-82cc-e55a59aefdab admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.469936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee89e-5951-4e51-82cc-e55a59aefdab admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.470211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee89e-5951-4e51-82cc-e55a59aefdab admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.470911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ee89e-5951-4e51-82cc-e55a59aefdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.472785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ee89e-5951-4e51-82cc-e55a59aefdab admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.485135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 942/1851] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:34.489491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ac47d-5041-4c3b-9d34-bd4e42ce2fc9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.500912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ac47d-5041-4c3b-9d34-bd4e42ce2fc9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.506533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0677-9e13-4493-b7d9-2a5e00fb40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.507367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0677-9e13-4493-b7d9-2a5e00fb40e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.507597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0677-9e13-4493-b7d9-2a5e00fb40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.507875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0677-9e13-4493-b7d9-2a5e00fb40e4 admin admin] PATH_INFO: `/v3/projects/5af1c3f3f7194edaa6c55c46625da96c/users/d73e33a99a1f4dcda34832bbbe6a0d9b/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.524250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b0677-9e13-4493-b7d9-2a5e00fb40e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af1c3f3f7194edaa6c55c46625da96c, user_id=d73e33a99a1f4dcda34832bbbe6a0d9b, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.527014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b0677-9e13-4493-b7d9-2a5e00fb40e4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.541322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 910/1852] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:34 2022] PUT /identity/v3/projects/5af1c3f3f7194edaa6c55c46625da96c/users/d73e33a99a1f4dcda34832bbbe6a0d9b/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:34.545441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee89e-5951-4e51-82cc-e55a59aefdab admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.556418 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee89e-5951-4e51-82cc-e55a59aefdab admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.624529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea47ac-397f-420a-8c09-d5606afabe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.627016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea47ac-397f-420a-8c09-d5606afabe05 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.627481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea47ac-397f-420a-8c09-d5606afabe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.627864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea47ac-397f-420a-8c09-d5606afabe05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.628785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea47ac-397f-420a-8c09-d5606afabe05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.630535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea47ac-397f-420a-8c09-d5606afabe05 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.638750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:34.651530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 943/1853] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:34.652908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0677-9e13-4493-b7d9-2a5e00fb40e4 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.671540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0677-9e13-4493-b7d9-2a5e00fb40e4 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.678453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.679183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.679472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.679757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] PATH_INFO: `/v3/projects/5af1c3f3f7194edaa6c55c46625da96c/users/d73e33a99a1f4dcda34832bbbe6a0d9b/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.682878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af1c3f3f7194edaa6c55c46625da96c, user_id=d73e33a99a1f4dcda34832bbbe6a0d9b, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.685568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.697207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 911/1854] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:34 2022] PUT /identity/v3/projects/5af1c3f3f7194edaa6c55c46625da96c/users/d73e33a99a1f4dcda34832bbbe6a0d9b/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:34.708874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5596ff3-7f6d-4bda-90e9-1f423b3393ed None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.709168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5596ff3-7f6d-4bda-90e9-1f423b3393ed None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.709458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5596ff3-7f6d-4bda-90e9-1f423b3393ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.738148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c5596ff3-7f6d-4bda-90e9-1f423b3393ed None None] MFA Rules not processed for user `d73e33a99a1f4dcda34832bbbe6a0d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:34.739412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c5596ff3-7f6d-4bda-90e9-1f423b3393ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:34.808366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 944/1855] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:34.818895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:34.820645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:34.852034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:34.879622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8117e-a92e-41fe-9271-3e22dc155f6a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:34.883331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:34.883954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:34.884237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:34.884514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:34.941335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:34.942868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:34.951968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 912/1856] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:35.492917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971d0f-c0e7-4ad4-a123-4885dbbd9a4f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:35.493499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971d0f-c0e7-4ad4-a123-4885dbbd9a4f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:35.493964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971d0f-c0e7-4ad4-a123-4885dbbd9a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:35.517487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-eb971d0f-c0e7-4ad4-a123-4885dbbd9a4f None None] MFA Rules not processed for user `77a234b8e5f2472cb3e733f933ca1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:35.518860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-eb971d0f-c0e7-4ad4-a123-4885dbbd9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:35.588206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 945/1857] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jul 26 07:52:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:35.641122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:35.641331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971d0f-c0e7-4ad4-a123-4885dbbd9a4f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:35.642576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:35.642955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-eb971d0f-c0e7-4ad4-a123-4885dbbd9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:35.659269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971d0f-c0e7-4ad4-a123-4885dbbd9a4f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:35.663423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46da4-df9e-4e05-865b-f03078332c11 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:35.664865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:35.665637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:35.666785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:35.667644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:35.669036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a73c27-90f6-4e3c-90ed-cd4278c1dd38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:35.669908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73c27-90f6-4e3c-90ed-cd4278c1dd38 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:35.670199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73c27-90f6-4e3c-90ed-cd4278c1dd38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:35.670482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a73c27-90f6-4e3c-90ed-cd4278c1dd38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:35.680295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:35.680746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a73c27-90f6-4e3c-90ed-cd4278c1dd38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:35.682175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a73c27-90f6-4e3c-90ed-cd4278c1dd38 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:35.682616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:35.691725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 913/1858] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:35.692679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a73c27-90f6-4e3c-90ed-cd4278c1dd38 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:35.693856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 946/1859] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:35.704761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a73c27-90f6-4e3c-90ed-cd4278c1dd38 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:35.712599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71201ecf-991a-4e37-9d46-00819b0cbbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:35.712599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71201ecf-991a-4e37-9d46-00819b0cbbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:35.712599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71201ecf-991a-4e37-9d46-00819b0cbbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:35.712959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71201ecf-991a-4e37-9d46-00819b0cbbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:35.728624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71201ecf-991a-4e37-9d46-00819b0cbbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:35.728624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71201ecf-991a-4e37-9d46-00819b0cbbc8 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:35.741644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 914/1860] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:36.847164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:36.848744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:36.987198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990099-edcb-42eb-98bc-95d1add620e2 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:36.993696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:36.994606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:36.995355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:36.995733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] PATH_INFO: `/v3/users/94d697cbea85431e851b4b60a461d5de` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:37.000128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d697cbea85431e851b4b60a461d5de)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:37.002200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:37.060818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:37.180798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d697cbea85431e851b4b60a461d5de'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:37.201847 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d697cbea85431e851b4b60a461d5de'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:37.221587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d697cbea85431e851b4b60a461d5de'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:37.223193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d697cbea85431e851b4b60a461d5de'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:37.265478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d697cbea85431e851b4b60a461d5de'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:37.292300 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f7d2-99f4-4df4-88ee-90746a96a96b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:37.292874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f7d2-99f4-4df4-88ee-90746a96a96b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:37.293086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f7d2-99f4-4df4-88ee-90746a96a96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:37.297240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 947/1861] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:36 2022] DELETE /identity/v3/users/94d697cbea85431e851b4b60a461d5de => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:37.341516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c4b3f7d2-99f4-4df4-88ee-90746a96a96b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:37.344354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c4b3f7d2-99f4-4df4-88ee-90746a96a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:37.444052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 915/1862] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:37.495753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:37.498174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:37.568603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d73ee-942c-48ae-82e2-8cd990cb2160 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:37.569282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d73ee-942c-48ae-82e2-8cd990cb2160 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:37.569575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d73ee-942c-48ae-82e2-8cd990cb2160 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:37.571140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 916/1863] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:52:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:52:37.603289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdd8ef-29fb-4bbd-a513-65ae51225fdb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:37.604101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdd8ef-29fb-4bbd-a513-65ae51225fdb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:37.604459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdd8ef-29fb-4bbd-a513-65ae51225fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:37.691647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c7fdd8ef-29fb-4bbd-a513-65ae51225fdb None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:37.696164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c7fdd8ef-29fb-4bbd-a513-65ae51225fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:37.717878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623ab15-7d4e-4c6e-beee-7361ca672d57 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:37.723436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:37.725135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:37.725429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:37.725706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:37.749786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:37.751453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:37.807607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 948/1864] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:37.947230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:37.986302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 917/1865] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:52:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:38.008488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:38.011175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:38.070917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eeead-77b2-4c15-974f-1e057d878332 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:38.091940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4fa03-e028-4577-9663-089b87239e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:38.091940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4fa03-e028-4577-9663-089b87239e3e service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:38.092403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4fa03-e028-4577-9663-089b87239e3e service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:38.092725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4fa03-e028-4577-9663-089b87239e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:38.117626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4fa03-e028-4577-9663-089b87239e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:38.120602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4fa03-e028-4577-9663-089b87239e3e service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:38.146849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 949/1866] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:38.888222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452aa16-f78b-40c9-b9a0-7b8ff6b01ed0 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:38.889641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452aa16-f78b-40c9-b9a0-7b8ff6b01ed0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:38.890170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452aa16-f78b-40c9-b9a0-7b8ff6b01ed0 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:38.900875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 918/1867] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:52:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:52:38.941350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c99c4f-3803-41ab-9fea-9694293ec8bf None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:38.941630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c99c4f-3803-41ab-9fea-9694293ec8bf None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:38.942074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c99c4f-3803-41ab-9fea-9694293ec8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:38.989196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-e3c99c4f-3803-41ab-9fea-9694293ec8bf None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:38.990542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e3c99c4f-3803-41ab-9fea-9694293ec8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:39.010996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 950/1868] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:52:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:39.050233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452aa16-f78b-40c9-b9a0-7b8ff6b01ed0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:39.060265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d452aa16-f78b-40c9-b9a0-7b8ff6b01ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:39.110143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452aa16-f78b-40c9-b9a0-7b8ff6b01ed0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:39.125786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:39.126439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:39.126731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:39.127032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:39.155020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:39.159297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:39.176546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 919/1869] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:39.180422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c99c4f-3803-41ab-9fea-9694293ec8bf None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:39.182063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e3c99c4f-3803-41ab-9fea-9694293ec8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:39.201294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c99c4f-3803-41ab-9fea-9694293ec8bf None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:39.214912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:39.216602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:39.217218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:39.217647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] PATH_INFO: `/v3/users/5c6339e860894a8a843b0e34394b2c85` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:39.219741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6339e860894a8a843b0e34394b2c85)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:39.222152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:39.351443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:39.353385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6339e860894a8a843b0e34394b2c85'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.354083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:39.374296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6339e860894a8a843b0e34394b2c85'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.404399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6339e860894a8a843b0e34394b2c85'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.406200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6339e860894a8a843b0e34394b2c85'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.412681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d4d5-dc43-4eb8-8abf-2d859c9bcb18 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:39.435394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:39.436356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:39.437951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:39.438447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] PATH_INFO: `/v3/projects/ba66b0d05f684551961d05d1da3f5c8d` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:39.438907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:39.444006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba66b0d05f684551961d05d1da3f5c8d)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:39.449561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-978daf80-ce2d-4622-8363-7f38ee613e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6339e860894a8a843b0e34394b2c85'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.450492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:39.469027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 951/1870] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:39 2022] DELETE /identity/v3/users/5c6339e860894a8a843b0e34394b2c85 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:39.472949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb331e-3c52-4d85-acaa-9d420effa915 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:39.473414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb331e-3c52-4d85-acaa-9d420effa915 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:39.473909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb331e-3c52-4d85-acaa-9d420effa915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:39.501827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3edb331e-3c52-4d85-acaa-9d420effa915 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:39.503107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3edb331e-3c52-4d85-acaa-9d420effa915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:39.578846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba66b0d05f684551961d05d1da3f5c8d', 'request_id': 'req-e4ab21a5-6457-4cc4-885b-367debba4025'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.590510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba66b0d05f684551961d05d1da3f5c8d', 'request_id': 'req-e4ab21a5-6457-4cc4-885b-367debba4025'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.604509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba66b0d05f684551961d05d1da3f5c8d', 'request_id': 'req-e4ab21a5-6457-4cc4-885b-367debba4025'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.612470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 952/1871] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:39.619848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] The token cache is being invalidate because project ba66b0d05f684551961d05d1da3f5c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:39.620234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.621268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.625005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb331e-3c52-4d85-acaa-9d420effa915 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:39.626202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 920/1872] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:39 2022] DELETE /identity/v3/projects/ba66b0d05f684551961d05d1da3f5c8d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:39.627162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3edb331e-3c52-4d85-acaa-9d420effa915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:39.627349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:39.628917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:39.710603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb331e-3c52-4d85-acaa-9d420effa915 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:39.714091 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab21a5-6457-4cc4-885b-367debba4025 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:39.720559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:39.721498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:39.721881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:39.722326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] PATH_INFO: `/v3/users/186419a69d4a4cd2afd742c2c63139c9` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:39.723829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186419a69d4a4cd2afd742c2c63139c9)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:39.725941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:39.783990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:39.784802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:39.785091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:39.785369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:39.787542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:39.802753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:39.804344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:39.813223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186419a69d4a4cd2afd742c2c63139c9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.816705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 953/1873] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:39.827881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186419a69d4a4cd2afd742c2c63139c9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.828980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186419a69d4a4cd2afd742c2c63139c9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.835985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:39.856707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186419a69d4a4cd2afd742c2c63139c9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.858286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186419a69d4a4cd2afd742c2c63139c9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:39.885637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 921/1874] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:39 2022] DELETE /identity/v3/users/186419a69d4a4cd2afd742c2c63139c9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:40.203709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:40.205302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:40.226115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da92041-d8cd-49f1-8d6f-0feaaffff3fb service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:40.293640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:40.296320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:40.300589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:40.316379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:40.317135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:40.317399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:40.317681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] PATH_INFO: `/v3/projects/2893db43cc8540c199c0a6005a508787` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:40.318890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2893db43cc8540c199c0a6005a508787)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:40.320867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:40.371511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2893db43cc8540c199c0a6005a508787', 'request_id': 'req-09ed0e27-f8ea-4310-a24b-3b973d15d33f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.373284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbc4a5-b884-4b9d-8650-6283e1f9baa7 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:40.379202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2893db43cc8540c199c0a6005a508787', 'request_id': 'req-09ed0e27-f8ea-4310-a24b-3b973d15d33f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.384968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2893db43cc8540c199c0a6005a508787', 'request_id': 'req-09ed0e27-f8ea-4310-a24b-3b973d15d33f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.397498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] The token cache is being invalidate because project 2893db43cc8540c199c0a6005a508787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:40.397789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.398598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.400698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 954/1875] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:40 2022] DELETE /identity/v3/projects/2893db43cc8540c199c0a6005a508787 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:40.404540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:40.405883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:40.434840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:40.435656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:40.435973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:40.436252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] PATH_INFO: `/v3/projects/d25c325fb9f44b9796fc351971489757` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:40.437428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25c325fb9f44b9796fc351971489757)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:40.439408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:40.470774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed0e27-f8ea-4310-a24b-3b973d15d33f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:40.477119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:40.478377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:40.478668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:40.478968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] PATH_INFO: `/v3/users/d73e33a99a1f4dcda34832bbbe6a0d9b` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:40.481489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73e33a99a1f4dcda34832bbbe6a0d9b)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:40.483567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:40.491398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25c325fb9f44b9796fc351971489757', 'request_id': 'req-ffea0199-afcc-49e8-9859-4dde8b5dc4de'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.499498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25c325fb9f44b9796fc351971489757', 'request_id': 'req-ffea0199-afcc-49e8-9859-4dde8b5dc4de'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.511478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25c325fb9f44b9796fc351971489757', 'request_id': 'req-ffea0199-afcc-49e8-9859-4dde8b5dc4de'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.526676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] The token cache is being invalidate because project d25c325fb9f44b9796fc351971489757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:40.527202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.527967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.530399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 922/1876] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:40 2022] DELETE /identity/v3/projects/d25c325fb9f44b9796fc351971489757 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:40.534002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:40.536267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:40.558563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73e33a99a1f4dcda34832bbbe6a0d9b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.561420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:40.570110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73e33a99a1f4dcda34832bbbe6a0d9b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.596742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73e33a99a1f4dcda34832bbbe6a0d9b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.598828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73e33a99a1f4dcda34832bbbe6a0d9b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.625845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73e33a99a1f4dcda34832bbbe6a0d9b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.641091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 955/1877] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:40 2022] DELETE /identity/v3/users/d73e33a99a1f4dcda34832bbbe6a0d9b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:40.648583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0199-afcc-49e8-9859-4dde8b5dc4de admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:40.741822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:40.742974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:40.742974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:40.743245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] PATH_INFO: `/v3/users/77827212722944b4a930d58fc6d8e69b` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:40.744434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77827212722944b4a930d58fc6d8e69b)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:40.746453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:40.809281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77827212722944b4a930d58fc6d8e69b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.817165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77827212722944b4a930d58fc6d8e69b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.818108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77827212722944b4a930d58fc6d8e69b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.831916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77827212722944b4a930d58fc6d8e69b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.832660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-31bfe85c-186b-433a-99bd-b486b53131f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77827212722944b4a930d58fc6d8e69b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:40.860997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 923/1878] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:40 2022] DELETE /identity/v3/users/77827212722944b4a930d58fc6d8e69b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:40.957747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:40.959279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:40.970001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:40.978367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f14f0-3a6f-4de8-8066-83c6a0e4df76 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.066186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.067311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.067756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.068186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] PATH_INFO: `/v3/projects/5af1c3f3f7194edaa6c55c46625da96c` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.069673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af1c3f3f7194edaa6c55c46625da96c)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.072458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.161464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af1c3f3f7194edaa6c55c46625da96c', 'request_id': 'req-b54f09bf-7e76-4a51-829e-318efba7de9a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.173133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af1c3f3f7194edaa6c55c46625da96c', 'request_id': 'req-b54f09bf-7e76-4a51-829e-318efba7de9a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.179409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af1c3f3f7194edaa6c55c46625da96c', 'request_id': 'req-b54f09bf-7e76-4a51-829e-318efba7de9a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.191980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] The token cache is being invalidate because project 5af1c3f3f7194edaa6c55c46625da96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:41.192276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.192944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.194556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 956/1879] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:40 2022] DELETE /identity/v3/projects/5af1c3f3f7194edaa6c55c46625da96c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:41.199784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211c5fb-ed83-4efc-ad6a-81507f804f36 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.200084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211c5fb-ed83-4efc-ad6a-81507f804f36 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.200369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211c5fb-ed83-4efc-ad6a-81507f804f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.222205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1211c5fb-ed83-4efc-ad6a-81507f804f36 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:41.223467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1211c5fb-ed83-4efc-ad6a-81507f804f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:41.229315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.231145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:41.270430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:41.295275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 924/1880] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:41.302494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfb75b-00df-44a5-8222-1d47c0e58a3d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.302776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfb75b-00df-44a5-8222-1d47c0e58a3d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.302942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f09bf-7e76-4a51-829e-318efba7de9a admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.303066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfb75b-00df-44a5-8222-1d47c0e58a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.307853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.308631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.308979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.309318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] PATH_INFO: `/v3/projects/e31378cfa4d14c60b453044b325a6f40` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.310683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31378cfa4d14c60b453044b325a6f40)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.312687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.325852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b2bfb75b-00df-44a5-8222-1d47c0e58a3d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:41.327142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b2bfb75b-00df-44a5-8222-1d47c0e58a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:41.336605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 925/1881] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:41.341508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfb75b-00df-44a5-8222-1d47c0e58a3d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.352239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfb75b-00df-44a5-8222-1d47c0e58a3d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.357182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.357808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.358089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.358366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.359099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:41.359402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.360814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:41.360993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.374318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31378cfa4d14c60b453044b325a6f40', 'request_id': 'req-754e011a-5077-4c79-9df3-c5e1e7013b3d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.375131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 926/1882] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:41.379178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.388861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31378cfa4d14c60b453044b325a6f40', 'request_id': 'req-754e011a-5077-4c79-9df3-c5e1e7013b3d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.392937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621949a7-0265-4ee2-90f2-1e1dcaa301ad admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.395785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31378cfa4d14c60b453044b325a6f40', 'request_id': 'req-754e011a-5077-4c79-9df3-c5e1e7013b3d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.423790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] The token cache is being invalidate because project e31378cfa4d14c60b453044b325a6f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:41.423790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.424058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-754e011a-5077-4c79-9df3-c5e1e7013b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:41.426611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 957/1883] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:41 2022] DELETE /identity/v3/projects/e31378cfa4d14c60b453044b325a6f40 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:41.431706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bc146-1c44-4655-85b8-736e6a43ca79 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.432079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bc146-1c44-4655-85b8-736e6a43ca79 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.432438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bc146-1c44-4655-85b8-736e6a43ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.460782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-801bc146-1c44-4655-85b8-736e6a43ca79 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:41.462781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-801bc146-1c44-4655-85b8-736e6a43ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:41.471153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.471788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.472071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.472396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.473068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.475062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.522610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 927/1884] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:41.524004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.531620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:41.548337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 958/1885] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:41.556365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b638-7380-4d4c-917e-18ed6e828ba6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.556763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b638-7380-4d4c-917e-18ed6e828ba6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.557043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b638-7380-4d4c-917e-18ed6e828ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.577614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-2c34b638-7380-4d4c-917e-18ed6e828ba6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:41.578811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2c34b638-7380-4d4c-917e-18ed6e828ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:41.610269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12fa0f-ed6d-43aa-8f62-cbeb34964d18 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.615191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b23a7-eb5e-43ef-9005-e3bc7a2f5ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.615813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b23a7-eb5e-43ef-9005-e3bc7a2f5ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.616098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b23a7-eb5e-43ef-9005-e3bc7a2f5ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.616373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b23a7-eb5e-43ef-9005-e3bc7a2f5ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.617081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b23a7-eb5e-43ef-9005-e3bc7a2f5ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.619068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b23a7-eb5e-43ef-9005-e3bc7a2f5ee9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.645308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 959/1886] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:41.648971 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 928/1887] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:41.649317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34b638-7380-4d4c-917e-18ed6e828ba6 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.650840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b23a7-eb5e-43ef-9005-e3bc7a2f5ee9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.659456 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34b638-7380-4d4c-917e-18ed6e828ba6 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.662391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b23a7-eb5e-43ef-9005-e3bc7a2f5ee9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.666191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.666718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.666978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.667326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.668049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:41.668330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fd536-1c80-4273-a689-5c2bb98632f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.668448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.669073 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd536-1c80-4273-a689-5c2bb98632f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.669513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd536-1c80-4273-a689-5c2bb98632f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.669862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd536-1c80-4273-a689-5c2bb98632f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.670062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.670765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fd536-1c80-4273-a689-5c2bb98632f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.673334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fd536-1c80-4273-a689-5c2bb98632f8 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.682345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 960/1888] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:41.686590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.687360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 929/1889] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:41.691012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fd536-1c80-4273-a689-5c2bb98632f8 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.697128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255838f5-5c06-49fb-b479-0b4781e7393b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.701789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f10d8b-da0d-48cc-b99d-18c3c1b6bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.702413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f10d8b-da0d-48cc-b99d-18c3c1b6bb61 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.702699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f10d8b-da0d-48cc-b99d-18c3c1b6bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.703039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f10d8b-da0d-48cc-b99d-18c3c1b6bb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.703714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f10d8b-da0d-48cc-b99d-18c3c1b6bb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.705641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f10d8b-da0d-48cc-b99d-18c3c1b6bb61 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.706753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fd536-1c80-4273-a689-5c2bb98632f8 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.713729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a915c-8e15-49d7-b515-c5ad7d027f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.714364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a915c-8e15-49d7-b515-c5ad7d027f16 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.714653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a915c-8e15-49d7-b515-c5ad7d027f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.714955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a915c-8e15-49d7-b515-c5ad7d027f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.715790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a915c-8e15-49d7-b515-c5ad7d027f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.717385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a915c-8e15-49d7-b515-c5ad7d027f16 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.732981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 930/1890] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:41.734013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a915c-8e15-49d7-b515-c5ad7d027f16 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.739665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 961/1891] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:41.743930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f10d8b-da0d-48cc-b99d-18c3c1b6bb61 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.744693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a915c-8e15-49d7-b515-c5ad7d027f16 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.756041 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:41.777003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:41.805256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d80ebd-bd53-4555-a814-f5c633a3fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.806450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80ebd-bd53-4555-a814-f5c633a3fc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.806740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80ebd-bd53-4555-a814-f5c633a3fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.807070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80ebd-bd53-4555-a814-f5c633a3fc88 admin admin] PATH_INFO: `/v3/projects/52656dc8de2f4f649266459015b406c7/users/4761e08b792346c68c03918035d72388/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.812638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f10d8b-da0d-48cc-b99d-18c3c1b6bb61 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.817303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c993a6f-d2c8-4f5e-84d7-c1574c0559e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.817925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993a6f-d2c8-4f5e-84d7-c1574c0559e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.818206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993a6f-d2c8-4f5e-84d7-c1574c0559e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.818487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993a6f-d2c8-4f5e-84d7-c1574c0559e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.819178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c993a6f-d2c8-4f5e-84d7-c1574c0559e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.821715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c993a6f-d2c8-4f5e-84d7-c1574c0559e8 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.821837 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80ebd-bd53-4555-a814-f5c633a3fc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52656dc8de2f4f649266459015b406c7, user_id=4761e08b792346c68c03918035d72388, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.824473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80ebd-bd53-4555-a814-f5c633a3fc88 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.837454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 931/1892] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:41 2022] PUT /identity/v3/projects/52656dc8de2f4f649266459015b406c7/users/4761e08b792346c68c03918035d72388/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:41.849021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d0a10-ebdb-4d19-b0a7-4a7f31db1e7b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.849567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d0a10-ebdb-4d19-b0a7-4a7f31db1e7b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.849681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 962/1893] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:41.852761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d0a10-ebdb-4d19-b0a7-4a7f31db1e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.853383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c993a6f-d2c8-4f5e-84d7-c1574c0559e8 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.863471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c993a6f-d2c8-4f5e-84d7-c1574c0559e8 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.881831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ee8d0a10-ebdb-4d19-b0a7-4a7f31db1e7b None None] MFA Rules not processed for user `4761e08b792346c68c03918035d72388`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:41.883116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ee8d0a10-ebdb-4d19-b0a7-4a7f31db1e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:41.934112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025b70e-50eb-432a-b983-cdb8f72d1d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.934949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025b70e-50eb-432a-b983-cdb8f72d1d17 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.935241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025b70e-50eb-432a-b983-cdb8f72d1d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.935522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025b70e-50eb-432a-b983-cdb8f72d1d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.936237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025b70e-50eb-432a-b983-cdb8f72d1d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.937836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025b70e-50eb-432a-b983-cdb8f72d1d17 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.948621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 963/1894] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:41.952672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025b70e-50eb-432a-b983-cdb8f72d1d17 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.957948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 932/1895] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:41.963144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d0a10-ebdb-4d19-b0a7-4a7f31db1e7b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:41.965592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025b70e-50eb-432a-b983-cdb8f72d1d17 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.970404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae28c5-80ca-49de-b223-d447e80deb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.971398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae28c5-80ca-49de-b223-d447e80deb34 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.971398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae28c5-80ca-49de-b223-d447e80deb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.971637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae28c5-80ca-49de-b223-d447e80deb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.972278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae28c5-80ca-49de-b223-d447e80deb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.973906 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae28c5-80ca-49de-b223-d447e80deb34 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.975286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d0a10-ebdb-4d19-b0a7-4a7f31db1e7b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:41.980158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95fc6e-5932-4d18-b078-3036984f360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:41.980853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95fc6e-5932-4d18-b078-3036984f360b admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:41.981151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95fc6e-5932-4d18-b078-3036984f360b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:41.981413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95fc6e-5932-4d18-b078-3036984f360b admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:41.982089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95fc6e-5932-4d18-b078-3036984f360b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:41.984026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95fc6e-5932-4d18-b078-3036984f360b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:41.989030 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 964/1896] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:41.989878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae28c5-80ca-49de-b223-d447e80deb34 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.000895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae28c5-80ca-49de-b223-d447e80deb34 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.005886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac9f8b-a9d0-4a81-a0a9-4592b27c072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.006727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9f8b-a9d0-4a81-a0a9-4592b27c072c admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.007090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9f8b-a9d0-4a81-a0a9-4592b27c072c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.007577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9f8b-a9d0-4a81-a0a9-4592b27c072c admin admin] PATH_INFO: `/v3/projects/64ac28a1929144c3a6ebf40a6d5dbe08/users/6a67b16db4604c3ca6a8a61f71078518/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.019649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 933/1897] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:41 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:42.023572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95fc6e-5932-4d18-b078-3036984f360b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.023703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac9f8b-a9d0-4a81-a0a9-4592b27c072c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ac28a1929144c3a6ebf40a6d5dbe08, user_id=6a67b16db4604c3ca6a8a61f71078518, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.026518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac9f8b-a9d0-4a81-a0a9-4592b27c072c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.040957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 965/1898] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:41 2022] PUT /identity/v3/projects/64ac28a1929144c3a6ebf40a6d5dbe08/users/6a67b16db4604c3ca6a8a61f71078518/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:42.053236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81eab-a81e-496a-bda8-6d1b3096ffae None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.053534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81eab-a81e-496a-bda8-6d1b3096ffae None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.053813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81eab-a81e-496a-bda8-6d1b3096ffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.083212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-fac81eab-a81e-496a-bda8-6d1b3096ffae None None] MFA Rules not processed for user `6a67b16db4604c3ca6a8a61f71078518`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:42.084670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fac81eab-a81e-496a-bda8-6d1b3096ffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:42.092938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95fc6e-5932-4d18-b078-3036984f360b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.104189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:42.168446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 966/1899] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:42.172630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81eab-a81e-496a-bda8-6d1b3096ffae None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.178173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463eb1b-e1e2-464a-bff0-86b90c18ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.178835 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463eb1b-e1e2-464a-bff0-86b90c18ccb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.179153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463eb1b-e1e2-464a-bff0-86b90c18ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.179427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463eb1b-e1e2-464a-bff0-86b90c18ccb6 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.180374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463eb1b-e1e2-464a-bff0-86b90c18ccb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.182948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463eb1b-e1e2-464a-bff0-86b90c18ccb6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.194131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81eab-a81e-496a-bda8-6d1b3096ffae None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.198972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4881-16ee-46d7-819b-9d69e67ed438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.199614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4881-16ee-46d7-819b-9d69e67ed438 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.199898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4881-16ee-46d7-819b-9d69e67ed438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.200174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4881-16ee-46d7-819b-9d69e67ed438 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.201005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac4881-16ee-46d7-819b-9d69e67ed438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.203052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac4881-16ee-46d7-819b-9d69e67ed438 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.209178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:42.212398 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 934/1900] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:42 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:42.218272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463eb1b-e1e2-464a-bff0-86b90c18ccb6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.230516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463eb1b-e1e2-464a-bff0-86b90c18ccb6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.235425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19571c-613d-417e-a1d6-62c62b717eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.235958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19571c-613d-417e-a1d6-62c62b717eda admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.236244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19571c-613d-417e-a1d6-62c62b717eda admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.236525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19571c-613d-417e-a1d6-62c62b717eda admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.237230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19571c-613d-417e-a1d6-62c62b717eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.238860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19571c-613d-417e-a1d6-62c62b717eda admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.243040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 967/1901] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:42 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:42.245389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4881-16ee-46d7-819b-9d69e67ed438 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.253984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 935/1902] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:42.257729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19571c-613d-417e-a1d6-62c62b717eda admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.268896 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19571c-613d-417e-a1d6-62c62b717eda admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.329767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4881-16ee-46d7-819b-9d69e67ed438 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.334734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5597b-00a1-4235-acbd-33af0e5ac65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.335399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5597b-00a1-4235-acbd-33af0e5ac65b admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.335692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5597b-00a1-4235-acbd-33af0e5ac65b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.335970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5597b-00a1-4235-acbd-33af0e5ac65b admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.336650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5597b-00a1-4235-acbd-33af0e5ac65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.338638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5597b-00a1-4235-acbd-33af0e5ac65b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.344193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb9a3-454d-4a71-997f-e4b9098955bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.344995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb9a3-454d-4a71-997f-e4b9098955bc admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.345290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb9a3-454d-4a71-997f-e4b9098955bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.345572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb9a3-454d-4a71-997f-e4b9098955bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.346446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb9a3-454d-4a71-997f-e4b9098955bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.348342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb9a3-454d-4a71-997f-e4b9098955bc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.365029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 936/1903] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:42.370266 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 968/1904] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:42 2022] POST /identity/v3/users => generated 307 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:42.371399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb9a3-454d-4a71-997f-e4b9098955bc admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.376007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5597b-00a1-4235-acbd-33af0e5ac65b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.383247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb9a3-454d-4a71-997f-e4b9098955bc admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.388618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5597b-00a1-4235-acbd-33af0e5ac65b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.389488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1a17b-aaf1-4fd5-a2d4-1b32c4e7e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.390250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a17b-aaf1-4fd5-a2d4-1b32c4e7e918 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.390460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a17b-aaf1-4fd5-a2d4-1b32c4e7e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.390744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a17b-aaf1-4fd5-a2d4-1b32c4e7e918 admin admin] PATH_INFO: `/v3/projects/e4bf66ba98924daa9f151c7e9a701190/users/3adc3e100ee6478a869aee62124466be/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.395413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e2de-effa-4d51-8218-930d1df95e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.396194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e2de-effa-4d51-8218-930d1df95e9c admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.396546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e2de-effa-4d51-8218-930d1df95e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.396889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e2de-effa-4d51-8218-930d1df95e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.397672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1e2de-effa-4d51-8218-930d1df95e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.399494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1e2de-effa-4d51-8218-930d1df95e9c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.410522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1a17b-aaf1-4fd5-a2d4-1b32c4e7e918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bf66ba98924daa9f151c7e9a701190, user_id=3adc3e100ee6478a869aee62124466be, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.413231 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 969/1905] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:42.413363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1a17b-aaf1-4fd5-a2d4-1b32c4e7e918 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.418176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e2de-effa-4d51-8218-930d1df95e9c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.432370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e2de-effa-4d51-8218-930d1df95e9c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.433706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 937/1906] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:42 2022] PUT /identity/v3/projects/e4bf66ba98924daa9f151c7e9a701190/users/3adc3e100ee6478a869aee62124466be/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:42.445812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d385-f43b-4233-a1f0-21a246826e7d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.446293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d385-f43b-4233-a1f0-21a246826e7d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.446680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d385-f43b-4233-a1f0-21a246826e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.481509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-90d7d385-f43b-4233-a1f0-21a246826e7d None None] MFA Rules not processed for user `3adc3e100ee6478a869aee62124466be`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:42.483400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-90d7d385-f43b-4233-a1f0-21a246826e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:42.521998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e0eb0-0741-4bdb-b331-5e561b049eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.522812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e0eb0-0741-4bdb-b331-5e561b049eef admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.523224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e0eb0-0741-4bdb-b331-5e561b049eef admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.523598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e0eb0-0741-4bdb-b331-5e561b049eef admin admin] PATH_INFO: `/v3/projects/3cbcd7f4806d445fab29534edbf47a8b/users/802b7357117a44129768910e7527fadd/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.542090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e0eb0-0741-4bdb-b331-5e561b049eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cbcd7f4806d445fab29534edbf47a8b, user_id=802b7357117a44129768910e7527fadd, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.545891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e0eb0-0741-4bdb-b331-5e561b049eef admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.567705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 970/1907] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:42 2022] PUT /identity/v3/projects/3cbcd7f4806d445fab29534edbf47a8b/users/802b7357117a44129768910e7527fadd/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:42.571682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e0eb0-0741-4bdb-b331-5e561b049eef admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.611806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:42.627944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 938/1908] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:42.635104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7d385-f43b-4233-a1f0-21a246826e7d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.636811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:42.650356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7d385-f43b-4233-a1f0-21a246826e7d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.655817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e0eb0-0741-4bdb-b331-5e561b049eef admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.656815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31354181-fe5a-4c04-9112-90395e9f7f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.657527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354181-fe5a-4c04-9112-90395e9f7f80 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.657885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354181-fe5a-4c04-9112-90395e9f7f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.658082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354181-fe5a-4c04-9112-90395e9f7f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.658768 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31354181-fe5a-4c04-9112-90395e9f7f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.661685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829bf89-f8b3-44b2-b1f0-081f29a0e74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.662640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829bf89-f8b3-44b2-b1f0-081f29a0e74c admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.662779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31354181-fe5a-4c04-9112-90395e9f7f80 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.663164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829bf89-f8b3-44b2-b1f0-081f29a0e74c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.663679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829bf89-f8b3-44b2-b1f0-081f29a0e74c admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.664570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829bf89-f8b3-44b2-b1f0-081f29a0e74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.666961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829bf89-f8b3-44b2-b1f0-081f29a0e74c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.682692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 971/1909] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:42.683780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829bf89-f8b3-44b2-b1f0-081f29a0e74c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.695515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829bf89-f8b3-44b2-b1f0-081f29a0e74c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.699685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 939/1910] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:42 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:42.703903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31354181-fe5a-4c04-9112-90395e9f7f80 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.789498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5025804-3bef-4cae-af44-7d7e969fb506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.790471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025804-3bef-4cae-af44-7d7e969fb506 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.790700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025804-3bef-4cae-af44-7d7e969fb506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.790920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025804-3bef-4cae-af44-7d7e969fb506 admin admin] PATH_INFO: `/v3/projects/3cbcd7f4806d445fab29534edbf47a8b/users/802b7357117a44129768910e7527fadd/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.793857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5025804-3bef-4cae-af44-7d7e969fb506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cbcd7f4806d445fab29534edbf47a8b, user_id=802b7357117a44129768910e7527fadd, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.796982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5025804-3bef-4cae-af44-7d7e969fb506 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.798590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31354181-fe5a-4c04-9112-90395e9f7f80 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.804469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c593e-f283-4e87-adfb-14cdbbfeb5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.806865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c593e-f283-4e87-adfb-14cdbbfeb5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.807644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c593e-f283-4e87-adfb-14cdbbfeb5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.809241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 972/1911] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:42 2022] PUT /identity/v3/projects/3cbcd7f4806d445fab29534edbf47a8b/users/802b7357117a44129768910e7527fadd/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:42.810750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c593e-f283-4e87-adfb-14cdbbfeb5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.812131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c593e-f283-4e87-adfb-14cdbbfeb5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.816740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c593e-f283-4e87-adfb-14cdbbfeb5e3 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.822296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584750f-918a-4176-b359-fc9b59d39950 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.823154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584750f-918a-4176-b359-fc9b59d39950 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.823442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584750f-918a-4176-b359-fc9b59d39950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.862067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a584750f-918a-4176-b359-fc9b59d39950 None None] MFA Rules not processed for user `802b7357117a44129768910e7527fadd`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:42.863354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a584750f-918a-4176-b359-fc9b59d39950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:42.867134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 940/1912] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:42 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:42.871370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c593e-f283-4e87-adfb-14cdbbfeb5e3 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:42.882586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c593e-f283-4e87-adfb-14cdbbfeb5e3 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:42.973046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:42.973046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:42.973046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:42.974057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:42.976384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:42.980132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:42.985123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 973/1913] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:42 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:42.994955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 941/1914] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:43.000112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584750f-918a-4176-b359-fc9b59d39950 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:43.001601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:43.004337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:43.016700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584750f-918a-4176-b359-fc9b59d39950 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:43.021838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15dd4-6d48-478e-a983-2ad5a2f21622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:43.022696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15dd4-6d48-478e-a983-2ad5a2f21622 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:43.023503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15dd4-6d48-478e-a983-2ad5a2f21622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:43.023955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15dd4-6d48-478e-a983-2ad5a2f21622 admin admin] PATH_INFO: `/v3/projects/c06585bba5084353a9ba8cd4d546bc47/users/c3b2c13893b14ff4bf5740210bc8eced/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:43.044007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f15dd4-6d48-478e-a983-2ad5a2f21622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06585bba5084353a9ba8cd4d546bc47, user_id=c3b2c13893b14ff4bf5740210bc8eced, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:43.047262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f15dd4-6d48-478e-a983-2ad5a2f21622 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:43.081070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039efc4f-d9a4-405c-85df-0bf54afd0616 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:43.085639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 974/1915] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:42 2022] PUT /identity/v3/projects/c06585bba5084353a9ba8cd4d546bc47/users/c3b2c13893b14ff4bf5740210bc8eced/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:43.090239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15dd4-6d48-478e-a983-2ad5a2f21622 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:43.097226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:43.162682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee4db-709a-4083-a35c-c1799e0afcb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:43.163502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee4db-709a-4083-a35c-c1799e0afcb1 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:43.163793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee4db-709a-4083-a35c-c1799e0afcb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:43.164125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee4db-709a-4083-a35c-c1799e0afcb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:43.171438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:43.200683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15dd4-6d48-478e-a983-2ad5a2f21622 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:43.205901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebea14a-2a0a-44a5-9ebb-6d65f2db23d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:43.206518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebea14a-2a0a-44a5-9ebb-6d65f2db23d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:43.206799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebea14a-2a0a-44a5-9ebb-6d65f2db23d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:43.207138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebea14a-2a0a-44a5-9ebb-6d65f2db23d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:43.207880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebea14a-2a0a-44a5-9ebb-6d65f2db23d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:43.209459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebea14a-2a0a-44a5-9ebb-6d65f2db23d2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:43.225152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 975/1916] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:43.226024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebea14a-2a0a-44a5-9ebb-6d65f2db23d2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:43.237290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebea14a-2a0a-44a5-9ebb-6d65f2db23d2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:43.237512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ee4db-709a-4083-a35c-c1799e0afcb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:43.239141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ee4db-709a-4083-a35c-c1799e0afcb1 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:43.242610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab89f8-661d-4b06-81f4-f28ba9d5194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:43.243357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab89f8-661d-4b06-81f4-f28ba9d5194f admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:43.243830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab89f8-661d-4b06-81f4-f28ba9d5194f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:43.243918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab89f8-661d-4b06-81f4-f28ba9d5194f admin admin] PATH_INFO: `/v3/projects/c06585bba5084353a9ba8cd4d546bc47/users/c3b2c13893b14ff4bf5740210bc8eced/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:43.245889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab89f8-661d-4b06-81f4-f28ba9d5194f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06585bba5084353a9ba8cd4d546bc47, user_id=c3b2c13893b14ff4bf5740210bc8eced, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:43.248736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab89f8-661d-4b06-81f4-f28ba9d5194f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:43.251065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 942/1917] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:43.261895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 976/1918] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:43 2022] PUT /identity/v3/projects/c06585bba5084353a9ba8cd4d546bc47/users/c3b2c13893b14ff4bf5740210bc8eced/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:43.273241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11fba-5f61-4b76-ba35-d32354197e03 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:43.273607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11fba-5f61-4b76-ba35-d32354197e03 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:43.273995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11fba-5f61-4b76-ba35-d32354197e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:43.310394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7bd11fba-5f61-4b76-ba35-d32354197e03 None None] MFA Rules not processed for user `c3b2c13893b14ff4bf5740210bc8eced`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:43.312241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7bd11fba-5f61-4b76-ba35-d32354197e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:43.330633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab89f8-661d-4b06-81f4-f28ba9d5194f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:43.389931 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab89f8-661d-4b06-81f4-f28ba9d5194f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:43.392084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 943/1919] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:43.394194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:43.395075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:43.395355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:43.395628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:43.404379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd11fba-5f61-4b76-ba35-d32354197e03 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:43.405733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7bd11fba-5f61-4b76-ba35-d32354197e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:43.417910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd11fba-5f61-4b76-ba35-d32354197e03 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:43.421582 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac06253-97da-4401-954a-15b7d81a5da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:43.422198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac06253-97da-4401-954a-15b7d81a5da6 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:43.422483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac06253-97da-4401-954a-15b7d81a5da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:43.422767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac06253-97da-4401-954a-15b7d81a5da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:43.454111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:43.455587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:43.464998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 977/1920] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:43.467819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:43.481608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac06253-97da-4401-954a-15b7d81a5da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:43.483081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac06253-97da-4401-954a-15b7d81a5da6 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:43.491961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 944/1921] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:45.986551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:45.990493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:46.079358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a41cc-92ec-4759-a5da-31b007cabf33 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:46.085317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:46.086267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:46.086734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:46.087152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] PATH_INFO: `/v3/users/c1eb6c09b2c9426c9137d761f7417c88` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:46.088925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1eb6c09b2c9426c9137d761f7417c88)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:46.091123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:46.130680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:46.151402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac06253-97da-4401-954a-15b7d81a5da6 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:46.162847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac06253-97da-4401-954a-15b7d81a5da6 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:46.165724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1eb6c09b2c9426c9137d761f7417c88'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:46.168450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:46.169203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:46.169364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:46.169648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:46.176434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1eb6c09b2c9426c9137d761f7417c88'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:46.186428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1eb6c09b2c9426c9137d761f7417c88'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:46.187321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1eb6c09b2c9426c9137d761f7417c88'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:46.214092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eddb731b-a097-42f4-ab0d-be13ccef427c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1eb6c09b2c9426c9137d761f7417c88'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:46.221525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 978/1922] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:45 2022] DELETE /identity/v3/users/c1eb6c09b2c9426c9137d761f7417c88 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:46.226313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b42d-c133-4aed-b74d-3d5a3961da05 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:46.226602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b42d-c133-4aed-b74d-3d5a3961da05 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:46.227150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b42d-c133-4aed-b74d-3d5a3961da05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:46.243792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:46.245991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:46.247110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ebe3b42d-c133-4aed-b74d-3d5a3961da05 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:46.248414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ebe3b42d-c133-4aed-b74d-3d5a3961da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:46.256289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 945/1923] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:46.319923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 979/1924] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:46.329695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:46.331025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:46.409771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1be63-880b-41b4-a576-0f48303c102c service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:46.480503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:46.481139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:46.481421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:46.481690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:46.492373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:46.494037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:46.505222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 946/1925] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:46.975000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b42d-c133-4aed-b74d-3d5a3961da05 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:46.976645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ebe3b42d-c133-4aed-b74d-3d5a3961da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:46.989914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b42d-c133-4aed-b74d-3d5a3961da05 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:47.000881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:47.002210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:47.003017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:47.004119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] PATH_INFO: `/v3/projects/cdfe813271734e90870b900ea33daa3e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:47.006440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfe813271734e90870b900ea33daa3e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:47.010910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:47.081075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:47.082526 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfe813271734e90870b900ea33daa3e', 'request_id': 'req-422d875c-177e-45c9-a00f-a7b655d15bfd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.083417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:47.090792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfe813271734e90870b900ea33daa3e', 'request_id': 'req-422d875c-177e-45c9-a00f-a7b655d15bfd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.099257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfe813271734e90870b900ea33daa3e', 'request_id': 'req-422d875c-177e-45c9-a00f-a7b655d15bfd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.113493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] The token cache is being invalidate because project cdfe813271734e90870b900ea33daa3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:47.113788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.114644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.119949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 980/1926] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:46 2022] DELETE /identity/v3/projects/cdfe813271734e90870b900ea33daa3e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:47.121446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:47.123188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:47.146332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:47.158168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:47.165236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ea73c-7eea-4ee1-90ac-73954ad6e535 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:47.210631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d875c-177e-45c9-a00f-a7b655d15bfd admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:47.216421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:47.217457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:47.217654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:47.218185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] PATH_INFO: `/v3/users/13007e316c5648a8b8bda6287be41ed7` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:47.219442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13007e316c5648a8b8bda6287be41ed7)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:47.221428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:47.229477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:47.230223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:47.230617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:47.231005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:47.233025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:47.278123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13007e316c5648a8b8bda6287be41ed7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.288489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13007e316c5648a8b8bda6287be41ed7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.297480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13007e316c5648a8b8bda6287be41ed7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.298168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13007e316c5648a8b8bda6287be41ed7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.308749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:47.310970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:47.313042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13007e316c5648a8b8bda6287be41ed7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.319147 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 981/1927] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:47 2022] DELETE /identity/v3/users/13007e316c5648a8b8bda6287be41ed7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:47.323793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 947/1928] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:47.613304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:47.615743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:47.714055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4357d1-1a06-4d91-9519-cc0ed0475f25 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:47.720783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:47.721703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:47.722132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:47.722549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] PATH_INFO: `/v3/projects/d00824e67ba5453196ed19f25c5ab3c9` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:47.725207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00824e67ba5453196ed19f25c5ab3c9)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:47.729312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:47.748607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:47.750445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:47.771685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29a2a-a52a-4dcb-a450-426634bad664 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:47.787121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:47.789558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:47.790919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:47.792448 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] PATH_INFO: `/v3/users/6a67b16db4604c3ca6a8a61f71078518` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:47.794976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a67b16db4604c3ca6a8a61f71078518)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:47.798516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:47.805391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:47.818014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00824e67ba5453196ed19f25c5ab3c9', 'request_id': 'req-d6c40d13-6adf-44d5-92df-ffa71e52302b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.840161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00824e67ba5453196ed19f25c5ab3c9', 'request_id': 'req-d6c40d13-6adf-44d5-92df-ffa71e52302b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.846097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00824e67ba5453196ed19f25c5ab3c9', 'request_id': 'req-d6c40d13-6adf-44d5-92df-ffa71e52302b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.873092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] The token cache is being invalidate because project d00824e67ba5453196ed19f25c5ab3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:47.874531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.879370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d6c40d13-6adf-44d5-92df-ffa71e52302b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.883418 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 982/1929] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:47 2022] DELETE /identity/v3/projects/d00824e67ba5453196ed19f25c5ab3c9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:47.886868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309f57-408c-4755-ae7c-7bcaf482a876 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:47.889636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309f57-408c-4755-ae7c-7bcaf482a876 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:47.890280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309f57-408c-4755-ae7c-7bcaf482a876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:47.901660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a67b16db4604c3ca6a8a61f71078518'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.941549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a67b16db4604c3ca6a8a61f71078518'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.942347 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a67b16db4604c3ca6a8a61f71078518'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.953631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-98309f57-408c-4755-ae7c-7bcaf482a876 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:47.954872 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-98309f57-408c-4755-ae7c-7bcaf482a876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:47.972245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a67b16db4604c3ca6a8a61f71078518'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:47.973692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1b7e2b-346e-4179-b17a-51b2de4ab9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a67b16db4604c3ca6a8a61f71078518'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:48.005811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 948/1930] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:47 2022] DELETE /identity/v3/users/6a67b16db4604c3ca6a8a61f71078518 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:48.007678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54d36-b20d-470f-82be-3e44be7a6325 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.008073 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54d36-b20d-470f-82be-3e44be7a6325 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.008555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54d36-b20d-470f-82be-3e44be7a6325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.032619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e2d54d36-b20d-470f-82be-3e44be7a6325 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:48.034139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e2d54d36-b20d-470f-82be-3e44be7a6325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:48.057033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:48.064524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 983/1931] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:48.086461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf1d46-bffb-4f79-af56-2dc145492594 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.087417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf1d46-bffb-4f79-af56-2dc145492594 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.088132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf1d46-bffb-4f79-af56-2dc145492594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.116088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-45cf1d46-bffb-4f79-af56-2dc145492594 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:48.118212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-45cf1d46-bffb-4f79-af56-2dc145492594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:48.178070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 949/1932] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:48.228108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54d36-b20d-470f-82be-3e44be7a6325 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.229769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e2d54d36-b20d-470f-82be-3e44be7a6325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:48.239868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 984/1933] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:48.244696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf1d46-bffb-4f79-af56-2dc145492594 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.246128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-45cf1d46-bffb-4f79-af56-2dc145492594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:48.247788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54d36-b20d-470f-82be-3e44be7a6325 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.253295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.254210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.254618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.254994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] PATH_INFO: `/v3/users/553664767fbe4e71aeea5f46ed7559c4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.256365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=553664767fbe4e71aeea5f46ed7559c4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:48.259732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:48.337383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf1d46-bffb-4f79-af56-2dc145492594 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.343290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bd91-0e72-47f2-a718-538606ebc9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.343871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd91-0e72-47f2-a718-538606ebc9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.344158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd91-0e72-47f2-a718-538606ebc9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.344437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd91-0e72-47f2-a718-538606ebc9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.356961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1bd91-0e72-47f2-a718-538606ebc9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:48.358658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1bd91-0e72-47f2-a718-538606ebc9a0 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:48.366302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553664767fbe4e71aeea5f46ed7559c4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:48.371630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 985/1934] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:48.372825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bd91-0e72-47f2-a718-538606ebc9a0 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.375439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553664767fbe4e71aeea5f46ed7559c4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:48.376155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553664767fbe4e71aeea5f46ed7559c4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:48.386402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bd91-0e72-47f2-a718-538606ebc9a0 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.392448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.393092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.393379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.393488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553664767fbe4e71aeea5f46ed7559c4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:48.393701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.394199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e4181f87-2075-44f0-82b0-0a9abc9f85bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553664767fbe4e71aeea5f46ed7559c4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:48.396608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:48.396938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:48.400566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:48.414363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:48.420144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 950/1935] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:48 2022] DELETE /identity/v3/users/553664767fbe4e71aeea5f46ed7559c4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:48.425019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9d09-5f2a-4d2a-bc2b-f12bc58e485e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.430874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 986/1936] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:48.431054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9d09-5f2a-4d2a-bc2b-f12bc58e485e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.431054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9d09-5f2a-4d2a-bc2b-f12bc58e485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.433588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.436325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:48.461454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f819af-f273-4b18-9132-564e268d7d82 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.472371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-610b9d09-5f2a-4d2a-bc2b-f12bc58e485e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:48.492080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-610b9d09-5f2a-4d2a-bc2b-f12bc58e485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:48.563891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4458e-5b0d-4326-bf39-cf08ab542b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.565335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4458e-5b0d-4326-bf39-cf08ab542b97 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.565803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4458e-5b0d-4326-bf39-cf08ab542b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.567043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4458e-5b0d-4326-bf39-cf08ab542b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.569293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4458e-5b0d-4326-bf39-cf08ab542b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:48.574907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4458e-5b0d-4326-bf39-cf08ab542b97 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:48.610403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 951/1937] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:48.635876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9d09-5f2a-4d2a-bc2b-f12bc58e485e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.638518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-610b9d09-5f2a-4d2a-bc2b-f12bc58e485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:48.654989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 987/1938] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:48 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:48.659192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4458e-5b0d-4326-bf39-cf08ab542b97 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.723608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:48.757621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9d09-5f2a-4d2a-bc2b-f12bc58e485e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.786127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4458e-5b0d-4326-bf39-cf08ab542b97 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.793429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6ae20-28e4-47d2-b3d6-9a3bfe00a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.794121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ae20-28e4-47d2-b3d6-9a3bfe00a333 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.794590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ae20-28e4-47d2-b3d6-9a3bfe00a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.794686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ae20-28e4-47d2-b3d6-9a3bfe00a333 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.796005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6ae20-28e4-47d2-b3d6-9a3bfe00a333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:48.799086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6ae20-28e4-47d2-b3d6-9a3bfe00a333 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:48.831412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 988/1939] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:48 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:48.835402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6ae20-28e4-47d2-b3d6-9a3bfe00a333 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.856001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6ae20-28e4-47d2-b3d6-9a3bfe00a333 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.860575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290760e-497f-42ef-898b-007076be85c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.861468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290760e-497f-42ef-898b-007076be85c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.861468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290760e-497f-42ef-898b-007076be85c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.861737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290760e-497f-42ef-898b-007076be85c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.865505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311203f-ea3a-4294-9835-9a90c37c3796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.866356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311203f-ea3a-4294-9835-9a90c37c3796 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.867090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311203f-ea3a-4294-9835-9a90c37c3796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.868984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311203f-ea3a-4294-9835-9a90c37c3796 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.870031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311203f-ea3a-4294-9835-9a90c37c3796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:48.882666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311203f-ea3a-4294-9835-9a90c37c3796 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:48.882788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290760e-497f-42ef-898b-007076be85c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:48.882788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290760e-497f-42ef-898b-007076be85c9 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:48.888919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 952/1940] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:48.906547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 989/1941] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:48.910720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290760e-497f-42ef-898b-007076be85c9 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.926853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290760e-497f-42ef-898b-007076be85c9 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.933891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.934852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.935262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.938330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:48.938330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:48.938330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:48.955068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 953/1942] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:48.956426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311203f-ea3a-4294-9835-9a90c37c3796 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:48.975197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311203f-ea3a-4294-9835-9a90c37c3796 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:48.989158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079749eb-c3a1-4090-a811-9c483227da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:48.990153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079749eb-c3a1-4090-a811-9c483227da6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:48.990555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079749eb-c3a1-4090-a811-9c483227da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:48.990887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079749eb-c3a1-4090-a811-9c483227da6e admin admin] PATH_INFO: `/v3/projects/2814ab92d34c48849c52b72645625b02/users/eeb5d9c7a2834db9a449513f05b96303/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.018200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079749eb-c3a1-4090-a811-9c483227da6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2814ab92d34c48849c52b72645625b02, user_id=eeb5d9c7a2834db9a449513f05b96303, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.032088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:49.032937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079749eb-c3a1-4090-a811-9c483227da6e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.034033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:49.059228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b895e-fcb2-45fc-8d87-4351056f8a85 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:49.060616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 990/1943] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:48 2022] PUT /identity/v3/projects/2814ab92d34c48849c52b72645625b02/users/eeb5d9c7a2834db9a449513f05b96303/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:49.072449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed437e-61ba-4465-b688-a05e8e63734d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.073356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed437e-61ba-4465-b688-a05e8e63734d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.073356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed437e-61ba-4465-b688-a05e8e63734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.131761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4eed437e-61ba-4465-b688-a05e8e63734d None None] MFA Rules not processed for user `eeb5d9c7a2834db9a449513f05b96303`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:49.133331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4eed437e-61ba-4465-b688-a05e8e63734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:49.192765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:49.195346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.196630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.197074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] PATH_INFO: `/v3/projects/64ac28a1929144c3a6ebf40a6d5dbe08` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.197707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:49.200302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ac28a1929144c3a6ebf40a6d5dbe08)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.206085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.252966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 991/1944] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:49.257298 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed437e-61ba-4465-b688-a05e8e63734d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:49.276591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed437e-61ba-4465-b688-a05e8e63734d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:49.283249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6836bae-4054-4705-8954-006f4fcfa3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:49.284069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6836bae-4054-4705-8954-006f4fcfa3be admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.284626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6836bae-4054-4705-8954-006f4fcfa3be admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.285048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6836bae-4054-4705-8954-006f4fcfa3be admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.285979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6836bae-4054-4705-8954-006f4fcfa3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.288618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6836bae-4054-4705-8954-006f4fcfa3be admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.333339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ac28a1929144c3a6ebf40a6d5dbe08', 'request_id': 'req-2095a61d-c457-4fab-8bc6-08f7f39157ea'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.346773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 992/1945] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:49 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:52:49.349822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ac28a1929144c3a6ebf40a6d5dbe08', 'request_id': 'req-2095a61d-c457-4fab-8bc6-08f7f39157ea'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.352247 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6836bae-4054-4705-8954-006f4fcfa3be admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:49.372616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ac28a1929144c3a6ebf40a6d5dbe08', 'request_id': 'req-2095a61d-c457-4fab-8bc6-08f7f39157ea'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.407013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] The token cache is being invalidate because project 64ac28a1929144c3a6ebf40a6d5dbe08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:49.407399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.410180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.416778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 954/1946] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:49 2022] DELETE /identity/v3/projects/64ac28a1929144c3a6ebf40a6d5dbe08 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:49.418103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:49.421833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:49.451078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:49.486228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6836bae-4054-4705-8954-006f4fcfa3be admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:49.493045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21128a5-1947-4a5d-b0b4-07b4c212af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:49.494181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21128a5-1947-4a5d-b0b4-07b4c212af37 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.494626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21128a5-1947-4a5d-b0b4-07b4c212af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.495457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21128a5-1947-4a5d-b0b4-07b4c212af37 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.496315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21128a5-1947-4a5d-b0b4-07b4c212af37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.499230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21128a5-1947-4a5d-b0b4-07b4c212af37 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.527727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a61d-c457-4fab-8bc6-08f7f39157ea admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:49.531462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 993/1947] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:49 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:49.532910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc6b1-f457-4953-8e98-59e194b158dc None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.533204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc6b1-f457-4953-8e98-59e194b158dc None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.533485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc6b1-f457-4953-8e98-59e194b158dc None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.534839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 994/1948] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:52:49.535585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cc6b1-f457-4953-8e98-59e194b158dc None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:49.536925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:49.537353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2b5cc6b1-f457-4953-8e98-59e194b158dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:49.537717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.538061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.538497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] PATH_INFO: `/v3/projects/1f74613ba961436f9b2886fdb9cfd18a` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.540358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f74613ba961436f9b2886fdb9cfd18a)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.542650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.560779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cc6b1-f457-4953-8e98-59e194b158dc None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:49.575430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:49.576245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.576762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.577044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] PATH_INFO: `/v3/users/802b7357117a44129768910e7527fadd` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.578229 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=802b7357117a44129768910e7527fadd)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.580207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.595012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f74613ba961436f9b2886fdb9cfd18a', 'request_id': 'req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.601211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f74613ba961436f9b2886fdb9cfd18a', 'request_id': 'req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.609409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f74613ba961436f9b2886fdb9cfd18a', 'request_id': 'req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.620943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] The token cache is being invalidate because project 1f74613ba961436f9b2886fdb9cfd18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:49.621259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.622715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.624793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 955/1949] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:49 2022] DELETE /identity/v3/projects/1f74613ba961436f9b2886fdb9cfd18a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:49.625640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:49.627063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:49.629546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802b7357117a44129768910e7527fadd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.639660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802b7357117a44129768910e7527fadd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.648171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802b7357117a44129768910e7527fadd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.648870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802b7357117a44129768910e7527fadd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.667507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4a590500-0903-431d-b602-69903fcec681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802b7357117a44129768910e7527fadd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.675002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 995/1950] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:49 2022] DELETE /identity/v3/users/802b7357117a44129768910e7527fadd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:49.676584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e42db-ddd4-4364-a4fd-8b3f299f2e0c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.676827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e42db-ddd4-4364-a4fd-8b3f299f2e0c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.677141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e42db-ddd4-4364-a4fd-8b3f299f2e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.707130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-521e42db-ddd4-4364-a4fd-8b3f299f2e0c None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:49.708755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-521e42db-ddd4-4364-a4fd-8b3f299f2e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:49.714774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:49.721499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3ab8f-fd32-4de2-80fe-550bf8a2060c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:49.817060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:49.831698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:49.832471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.832672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.834463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.835944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.838180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.854181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 996/1951] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:49.855761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e42db-ddd4-4364-a4fd-8b3f299f2e0c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:49.857894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-521e42db-ddd4-4364-a4fd-8b3f299f2e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:49.860586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 956/1952] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:49.867594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:49.869786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:49.888018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb8b4e-c9bd-41e0-9512-e082b484d552 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:49.888208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e42db-ddd4-4364-a4fd-8b3f299f2e0c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:49.894057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:49.894865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:49.895143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.895601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.895869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:49.896113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] PATH_INFO: `/v3/users/1ada29f540274d82a01b673d48ac04f2` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.896291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:49.897317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] PATH_INFO: `/v3/projects/3f3508733b9d4259bb9bb36ebd72a486/users/4e0a97e94b864db89d67d07fd813166f/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:49.897609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ada29f540274d82a01b673d48ac04f2)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.901228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.954910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3508733b9d4259bb9bb36ebd72a486, user_id=4e0a97e94b864db89d67d07fd813166f, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:49.963451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:49.973721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ada29f540274d82a01b673d48ac04f2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:49.988688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ada29f540274d82a01b673d48ac04f2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.001732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ada29f540274d82a01b673d48ac04f2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.004237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ada29f540274d82a01b673d48ac04f2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.020622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ada29f540274d82a01b673d48ac04f2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.029428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 957/1953] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:49 2022] PUT /identity/v3/projects/3f3508733b9d4259bb9bb36ebd72a486/users/4e0a97e94b864db89d67d07fd813166f/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:50.029567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 997/1954] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:49 2022] DELETE /identity/v3/users/1ada29f540274d82a01b673d48ac04f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:50.029658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:50.033251 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:50.033993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.036135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.193679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846c50c-4aac-408d-ae76-2a7b65c24dde admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:50.201153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:50.201889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.202177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.202452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.203210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:50.206452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:50.225512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 998/1955] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:50.225691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423bcf6-f0a6-4bbc-b03f-ea83d4c59fa1 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:50.226120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:50.226120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.247808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822f080-11a6-4a27-9100-c782156a7b61 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:50.255566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:50.256524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.256961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.257415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] PATH_INFO: `/v3/projects/3cbcd7f4806d445fab29534edbf47a8b` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.259944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cbcd7f4806d445fab29534edbf47a8b)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:50.261942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:50.265701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:50.322855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97070131-1406-413c-a9c8-32591635209c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:50.323117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070131-1406-413c-a9c8-32591635209c service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.323455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070131-1406-413c-a9c8-32591635209c service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.323826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070131-1406-413c-a9c8-32591635209c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.325906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-97070131-1406-413c-a9c8-32591635209c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.345336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97070131-1406-413c-a9c8-32591635209c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:50.346694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97070131-1406-413c-a9c8-32591635209c service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:50.354750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cbcd7f4806d445fab29534edbf47a8b', 'request_id': 'req-6bc5832f-417f-4474-af9f-650435bbefb6'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.361005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 958/1956] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:50.362097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97070131-1406-413c-a9c8-32591635209c service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:50.365039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cbcd7f4806d445fab29534edbf47a8b', 'request_id': 'req-6bc5832f-417f-4474-af9f-650435bbefb6'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.373689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cbcd7f4806d445fab29534edbf47a8b', 'request_id': 'req-6bc5832f-417f-4474-af9f-650435bbefb6'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.374169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97070131-1406-413c-a9c8-32591635209c service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:50.389560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] The token cache is being invalidate because project 3cbcd7f4806d445fab29534edbf47a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:50.390194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.391041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6bc5832f-417f-4474-af9f-650435bbefb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.393138 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 999/1957] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:50 2022] DELETE /identity/v3/projects/3cbcd7f4806d445fab29534edbf47a8b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:50.403187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44416f18-6b84-418e-b3a3-8049fb0f4d06 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.403931 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44416f18-6b84-418e-b3a3-8049fb0f4d06 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.404454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44416f18-6b84-418e-b3a3-8049fb0f4d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.431910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-44416f18-6b84-418e-b3a3-8049fb0f4d06 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:50.433215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-44416f18-6b84-418e-b3a3-8049fb0f4d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.436292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:50.492377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884c111-6cf6-402c-8833-1a3b07e25690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:50.494292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884c111-6cf6-402c-8833-1a3b07e25690 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.494693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884c111-6cf6-402c-8833-1a3b07e25690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.495106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884c111-6cf6-402c-8833-1a3b07e25690 admin admin] PATH_INFO: `/v3/projects/3f3508733b9d4259bb9bb36ebd72a486/users/4e0a97e94b864db89d67d07fd813166f/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.500866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884c111-6cf6-402c-8833-1a3b07e25690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3508733b9d4259bb9bb36ebd72a486, user_id=4e0a97e94b864db89d67d07fd813166f, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:50.504980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884c111-6cf6-402c-8833-1a3b07e25690 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:50.536406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1000/1958] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:50.537320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44416f18-6b84-418e-b3a3-8049fb0f4d06 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:50.538849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-44416f18-6b84-418e-b3a3-8049fb0f4d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.546303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 959/1959] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:50 2022] PUT /identity/v3/projects/3f3508733b9d4259bb9bb36ebd72a486/users/4e0a97e94b864db89d67d07fd813166f/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:50.553833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b667b-7237-4703-bc71-7335735a063f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.553833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b667b-7237-4703-bc71-7335735a063f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.553833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b667b-7237-4703-bc71-7335735a063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.554186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44416f18-6b84-418e-b3a3-8049fb0f4d06 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:50.581794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-824b667b-7237-4703-bc71-7335735a063f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:50.585927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-824b667b-7237-4703-bc71-7335735a063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.658149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:50.659002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.659291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.659632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] PATH_INFO: `/v3/projects/20b62e13f66c4a8aae066e26cc0fbff6` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.661144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b62e13f66c4a8aae066e26cc0fbff6)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:50.665363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:50.682289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 960/1960] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:50.683634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab29-7647-43d8-a4fd-f75c58f7ea4a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.683930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab29-7647-43d8-a4fd-f75c58f7ea4a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.684210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab29-7647-43d8-a4fd-f75c58f7ea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.719311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-045bab29-7647-43d8-a4fd-f75c58f7ea4a None None] MFA Rules not processed for user `4e0a97e94b864db89d67d07fd813166f`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:50.720566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-045bab29-7647-43d8-a4fd-f75c58f7ea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.732755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:50.746657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b62e13f66c4a8aae066e26cc0fbff6', 'request_id': 'req-e12c722d-0008-437c-9f1d-ebb20b97f255'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.755838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b62e13f66c4a8aae066e26cc0fbff6', 'request_id': 'req-e12c722d-0008-437c-9f1d-ebb20b97f255'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.763399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b62e13f66c4a8aae066e26cc0fbff6', 'request_id': 'req-e12c722d-0008-437c-9f1d-ebb20b97f255'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.779397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] The token cache is being invalidate because project 20b62e13f66c4a8aae066e26cc0fbff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:50.779729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.780720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:50.783371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1001/1961] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:50 2022] DELETE /identity/v3/projects/20b62e13f66c4a8aae066e26cc0fbff6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:50.784116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:50.785731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.818105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 961/1962] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:50.819518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951551-93b8-405f-bc3b-bf66fdd753fe None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.819884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951551-93b8-405f-bc3b-bf66fdd753fe None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.820234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951551-93b8-405f-bc3b-bf66fdd753fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.842827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3d951551-93b8-405f-bc3b-bf66fdd753fe None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:50.846379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3d951551-93b8-405f-bc3b-bf66fdd753fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.870495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c722d-0008-437c-9f1d-ebb20b97f255 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:50.892246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:50.892895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:50.893176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:50.893494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:50.894261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:50.894573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:50.897300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:50.917214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1002/1963] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:50.917214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:50.917447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:50.990979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 962/1964] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:50.990979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d951551-93b8-405f-bc3b-bf66fdd753fe None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.010873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d951551-93b8-405f-bc3b-bf66fdd753fe None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.029051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56358d74-0aa2-46d2-ac35-25172a497357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.029865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56358d74-0aa2-46d2-ac35-25172a497357 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.030255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56358d74-0aa2-46d2-ac35-25172a497357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.031168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56358d74-0aa2-46d2-ac35-25172a497357 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.031865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56358d74-0aa2-46d2-ac35-25172a497357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.034256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56358d74-0aa2-46d2-ac35-25172a497357 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.041908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:51.045600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25cfb5-3e9f-44e0-add6-e883e4d022a9 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.069550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58372-7724-43d8-96d4-3e32706f97df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.070831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58372-7724-43d8-96d4-3e32706f97df service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.070831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58372-7724-43d8-96d4-3e32706f97df service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.071523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a58372-7724-43d8-96d4-3e32706f97df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.094290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 963/1965] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:50 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:51.096799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320d90f-e3bf-40d3-9358-80b459902e9a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.097320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320d90f-e3bf-40d3-9358-80b459902e9a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.098028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320d90f-e3bf-40d3-9358-80b459902e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.122348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c320d90f-e3bf-40d3-9358-80b459902e9a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:51.124609 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c320d90f-e3bf-40d3-9358-80b459902e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.180616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a58372-7724-43d8-96d4-3e32706f97df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.182104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a58372-7724-43d8-96d4-3e32706f97df service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.197075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1003/1966] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:51.210476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 964/1967] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:51.212853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58372-7724-43d8-96d4-3e32706f97df service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.227875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320d90f-e3bf-40d3-9358-80b459902e9a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.247473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320d90f-e3bf-40d3-9358-80b459902e9a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.253424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a58372-7724-43d8-96d4-3e32706f97df service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.253979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.254844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.255239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.255598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.257762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:51.258165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.259269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.260200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.261336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.261541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.262872 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.263793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.266131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.277180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 965/1968] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:51.279781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:51.289010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.310183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1004/1969] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:51 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:51.311358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.313493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.313845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bc2e2-4334-4f71-8c41-836c9f07442c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.327631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4245d-09b9-4d9e-9405-55a10653d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.328243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4245d-09b9-4d9e-9405-55a10653d941 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.328531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4245d-09b9-4d9e-9405-55a10653d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.328817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4245d-09b9-4d9e-9405-55a10653d941 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.330290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4245d-09b9-4d9e-9405-55a10653d941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.331311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b7de2-2f59-445d-a133-95706ad07f2b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.332576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4245d-09b9-4d9e-9405-55a10653d941 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.338001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.339619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.340784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.341214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] PATH_INFO: `/v3/users/eeb5d9c7a2834db9a449513f05b96303` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.342693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb5d9c7a2834db9a449513f05b96303)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.345839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.384919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 966/1970] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:51 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:51.386248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4245d-09b9-4d9e-9405-55a10653d941 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.410411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb5d9c7a2834db9a449513f05b96303'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.418985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb5d9c7a2834db9a449513f05b96303'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.427530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb5d9c7a2834db9a449513f05b96303'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.428217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb5d9c7a2834db9a449513f05b96303'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.453518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb5d9c7a2834db9a449513f05b96303'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.463522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1005/1971] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:51 2022] DELETE /identity/v3/users/eeb5d9c7a2834db9a449513f05b96303 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:51.464457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.466030 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.471842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4245d-09b9-4d9e-9405-55a10653d941 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.531718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:51.538573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304186e-ea7f-478b-b7cd-8259d13115e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.539442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304186e-ea7f-478b-b7cd-8259d13115e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.539754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304186e-ea7f-478b-b7cd-8259d13115e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.540032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304186e-ea7f-478b-b7cd-8259d13115e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.540733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304186e-ea7f-478b-b7cd-8259d13115e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.542364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304186e-ea7f-478b-b7cd-8259d13115e5 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.543919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273c0c2-a223-4194-8320-7d4039383bc9 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.549761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.550435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.550743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.551050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.551757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.556176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 967/1972] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:51.556313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.556413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a043-4e13-4e2a-9848-83bc4743a4f8 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.556413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a043-4e13-4e2a-9848-83bc4743a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.556413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a043-4e13-4e2a-9848-83bc4743a4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.575929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a496a043-4e13-4e2a-9848-83bc4743a4f8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:51.577144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a496a043-4e13-4e2a-9848-83bc4743a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.580780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1006/1973] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:51 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:51.580780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.580780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.585992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 968/1974] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:51.586831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496a043-4e13-4e2a-9848-83bc4743a4f8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.594087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223d330-68b3-4941-8672-e44dda876a09 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.598782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.599252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496a043-4e13-4e2a-9848-83bc4743a4f8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.599544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.599827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.600102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.600831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.602435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.604592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd55d8-34b2-4c8f-a965-f8cd1dabedfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.605207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd55d8-34b2-4c8f-a965-f8cd1dabedfa admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.605488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd55d8-34b2-4c8f-a965-f8cd1dabedfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.605761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd55d8-34b2-4c8f-a965-f8cd1dabedfa admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.606457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd55d8-34b2-4c8f-a965-f8cd1dabedfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.608061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd55d8-34b2-4c8f-a965-f8cd1dabedfa admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.612589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1007/1975] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:51.613618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.615087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.621873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 969/1976] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:51.621873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd55d8-34b2-4c8f-a965-f8cd1dabedfa admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.634514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd55d8-34b2-4c8f-a965-f8cd1dabedfa admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.639582 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e757f-cfb2-4ff9-8fc6-25b5850ec40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.640248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e757f-cfb2-4ff9-8fc6-25b5850ec40d admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.640533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e757f-cfb2-4ff9-8fc6-25b5850ec40d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.640810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e757f-cfb2-4ff9-8fc6-25b5850ec40d admin admin] PATH_INFO: `/v3/projects/94bca14a05374f3bbdbfa9ac35af19c3/users/4771347e11d849e195f64132902eb1c3/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.655262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e757f-cfb2-4ff9-8fc6-25b5850ec40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bca14a05374f3bbdbfa9ac35af19c3, user_id=4771347e11d849e195f64132902eb1c3, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.658068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e757f-cfb2-4ff9-8fc6-25b5850ec40d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.663203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:INSERT=7,keystone:SELECT=83,keystone:DELETE=10 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:51.673432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 970/1977] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:51 2022] PUT /identity/v3/projects/94bca14a05374f3bbdbfa9ac35af19c3/users/4771347e11d849e195f64132902eb1c3/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:51.674251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e757f-cfb2-4ff9-8fc6-25b5850ec40d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.682886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae88a3-fc7f-43b3-bf4a-ad1cd7a4757a admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.748498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df1c3e-f6da-4501-8405-32f7b30f9ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.749136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df1c3e-f6da-4501-8405-32f7b30f9ecd service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.749425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df1c3e-f6da-4501-8405-32f7b30f9ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.749732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df1c3e-f6da-4501-8405-32f7b30f9ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.760435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df1c3e-f6da-4501-8405-32f7b30f9ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.760603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e757f-cfb2-4ff9-8fc6-25b5850ec40d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.761891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df1c3e-f6da-4501-8405-32f7b30f9ecd service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.765751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.766474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.766856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.767608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.768065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.769742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.772654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1008/1978] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:51.773967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78969d8-9ffb-4769-8923-3c11d35659c1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.774368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78969d8-9ffb-4769-8923-3c11d35659c1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.774727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78969d8-9ffb-4769-8923-3c11d35659c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.783550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 971/1979] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:51.783550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.783550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.797756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8f5c-a3d1-4486-9d39-0f505210c84a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.802766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:51.803514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:51.803858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:51.803986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c78969d8-9ffb-4769-8923-3c11d35659c1 None None] MFA Rules not processed for user `4771347e11d849e195f64132902eb1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:51.804255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] PATH_INFO: `/v3/users/4761e08b792346c68c03918035d72388` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:51.806544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c78969d8-9ffb-4769-8923-3c11d35659c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.806665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4761e08b792346c68c03918035d72388)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:51.808201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:51.867633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4761e08b792346c68c03918035d72388'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.877112 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4761e08b792346c68c03918035d72388'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.878281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4761e08b792346c68c03918035d72388'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.893448 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4761e08b792346c68c03918035d72388'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.895418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4761e08b792346c68c03918035d72388'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:51.904538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1009/1980] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:51.905446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78969d8-9ffb-4769-8923-3c11d35659c1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.906940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c78969d8-9ffb-4769-8923-3c11d35659c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.921060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78969d8-9ffb-4769-8923-3c11d35659c1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:51.922055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 972/1981] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:51 2022] DELETE /identity/v3/users/4761e08b792346c68c03918035d72388 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:51.923365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:51.925572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:51.953603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:52.042014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8ccef-2646-4318-9175-2b2bd926231c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.044951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0153-118b-48f5-a422-c0b54132bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.045446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32fb4c-5110-46a9-90ff-d26342b35cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.046200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32fb4c-5110-46a9-90ff-d26342b35cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.046305 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0153-118b-48f5-a422-c0b54132bd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.046667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0153-118b-48f5-a422-c0b54132bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.046766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32fb4c-5110-46a9-90ff-d26342b35cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.047133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32fb4c-5110-46a9-90ff-d26342b35cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.047259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0153-118b-48f5-a422-c0b54132bd86 admin admin] PATH_INFO: `/v3/projects/fef866767c4344a4beec046608cf3271/users/41a3af1c41d34873b5d05d5f86d64128/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.047968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32fb4c-5110-46a9-90ff-d26342b35cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.050142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32fb4c-5110-46a9-90ff-d26342b35cc1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.063073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0153-118b-48f5-a422-c0b54132bd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef866767c4344a4beec046608cf3271, user_id=41a3af1c41d34873b5d05d5f86d64128, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.065941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0153-118b-48f5-a422-c0b54132bd86 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.090140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1010/1982] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:51 2022] PUT /identity/v3/projects/fef866767c4344a4beec046608cf3271/users/41a3af1c41d34873b5d05d5f86d64128/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:52.091991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f7a46-804e-48df-ac27-01c40b11d4ce None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.092292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f7a46-804e-48df-ac27-01c40b11d4ce None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.092937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f7a46-804e-48df-ac27-01c40b11d4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.101901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 973/1983] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:51 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:52.104135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6ca8-3ec5-4ca6-afd4-6d0574da0268 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.104428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6ca8-3ec5-4ca6-afd4-6d0574da0268 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.105461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e6ca8-3ec5-4ca6-afd4-6d0574da0268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.122670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5a6f7a46-804e-48df-ac27-01c40b11d4ce None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:52.124100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5a6f7a46-804e-48df-ac27-01c40b11d4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.130378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:52.139856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-096e6ca8-3ec5-4ca6-afd4-6d0574da0268 None None] MFA Rules not processed for user `41a3af1c41d34873b5d05d5f86d64128`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:52.141405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-096e6ca8-3ec5-4ca6-afd4-6d0574da0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.195364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1011/1984] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:52.195364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f7a46-804e-48df-ac27-01c40b11d4ce None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.204245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f7a46-804e-48df-ac27-01c40b11d4ce None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.210581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a32a1-9a92-40b2-be04-d427ab2f745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.211188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a32a1-9a92-40b2-be04-d427ab2f745f admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.212042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a32a1-9a92-40b2-be04-d427ab2f745f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.212275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a32a1-9a92-40b2-be04-d427ab2f745f admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.213069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a32a1-9a92-40b2-be04-d427ab2f745f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.214659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 974/1985] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:52.215571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e6ca8-3ec5-4ca6-afd4-6d0574da0268 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.217017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-096e6ca8-3ec5-4ca6-afd4-6d0574da0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.218455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a32a1-9a92-40b2-be04-d427ab2f745f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.245561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1012/1986] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:52 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:52.246385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a32a1-9a92-40b2-be04-d427ab2f745f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.261671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a32a1-9a92-40b2-be04-d427ab2f745f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.267453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.268144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.268426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.268700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.269374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.271336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.280904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e6ca8-3ec5-4ca6-afd4-6d0574da0268 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.285110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460538-f57f-4927-9f42-3e93380bb867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.285742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460538-f57f-4927-9f42-3e93380bb867 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.286025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460538-f57f-4927-9f42-3e93380bb867 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.286304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460538-f57f-4927-9f42-3e93380bb867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.296562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6460538-f57f-4927-9f42-3e93380bb867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.298003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6460538-f57f-4927-9f42-3e93380bb867 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.300437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1013/1987] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:52 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:52.304006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.305675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.308053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 975/1988] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:52.308748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460538-f57f-4927-9f42-3e93380bb867 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.318391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460538-f57f-4927-9f42-3e93380bb867 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.366070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:52.380639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f7af9-9570-4450-9ca9-1dda10a87da2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.387093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.388057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.388389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.388685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] PATH_INFO: `/v3/projects/2814ab92d34c48849c52b72645625b02` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.390009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2814ab92d34c48849c52b72645625b02)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.392584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.396527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b4c5e-6a3f-42a4-9a4e-b6c2f2722eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.397252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b4c5e-6a3f-42a4-9a4e-b6c2f2722eaa admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.397539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b4c5e-6a3f-42a4-9a4e-b6c2f2722eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.397813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b4c5e-6a3f-42a4-9a4e-b6c2f2722eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.398542 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b4c5e-6a3f-42a4-9a4e-b6c2f2722eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.401149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b4c5e-6a3f-42a4-9a4e-b6c2f2722eaa admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.415730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 976/1989] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:52.415730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b4c5e-6a3f-42a4-9a4e-b6c2f2722eaa admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.423772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b4c5e-6a3f-42a4-9a4e-b6c2f2722eaa admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.428488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecee2e-8d65-4071-ae94-595136f98992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.429146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecee2e-8d65-4071-ae94-595136f98992 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.429444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecee2e-8d65-4071-ae94-595136f98992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.429865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecee2e-8d65-4071-ae94-595136f98992 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.430593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecee2e-8d65-4071-ae94-595136f98992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.433565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecee2e-8d65-4071-ae94-595136f98992 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.459538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 977/1990] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:52 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:52.459538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecee2e-8d65-4071-ae94-595136f98992 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.467861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2814ab92d34c48849c52b72645625b02', 'request_id': 'req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.469385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecee2e-8d65-4071-ae94-595136f98992 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.491609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2814ab92d34c48849c52b72645625b02', 'request_id': 'req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.501185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2814ab92d34c48849c52b72645625b02', 'request_id': 'req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.533863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] The token cache is being invalidate because project 2814ab92d34c48849c52b72645625b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:52.534179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.535460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.537446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1014/1991] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:52 2022] DELETE /identity/v3/projects/2814ab92d34c48849c52b72645625b02 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:52.539392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.543345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.544327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.545155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.545432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.545667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.546384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.550871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.565442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 978/1992] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:52.566507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.571602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:52.571797 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.579309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd545d-6d2a-43f5-b93c-4fe9f1d82b73 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.587728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.588593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.589866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.591327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.592361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.595080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.600888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f045be-7d96-4668-acf5-17f5d66a2ba2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.606530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1015/1993] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:52.607315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.609081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.614062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.615371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.615679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.616099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] PATH_INFO: `/v3/users/4e0a97e94b864db89d67d07fd813166f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.617366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0a97e94b864db89d67d07fd813166f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.620129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.623935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f92c9-c1dd-41ca-b13a-a10ccc0f1ecb admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.632081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bcd7c-4513-407e-8150-2b37f9ada998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.635241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bcd7c-4513-407e-8150-2b37f9ada998 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.635535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bcd7c-4513-407e-8150-2b37f9ada998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.636010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bcd7c-4513-407e-8150-2b37f9ada998 admin admin] PATH_INFO: `/v3/projects/d8c6ab55788b448ba746a78aaafbec28/users/c8196350cbc140c8b97df914d58c9319/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.660585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bcd7c-4513-407e-8150-2b37f9ada998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c6ab55788b448ba746a78aaafbec28, user_id=c8196350cbc140c8b97df914d58c9319, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.663283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bcd7c-4513-407e-8150-2b37f9ada998 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.682901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1016/1994] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:52 2022] PUT /identity/v3/projects/d8c6ab55788b448ba746a78aaafbec28/users/c8196350cbc140c8b97df914d58c9319/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:52.687904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bcd7c-4513-407e-8150-2b37f9ada998 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.697256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0a97e94b864db89d67d07fd813166f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.705069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0a97e94b864db89d67d07fd813166f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.705851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0a97e94b864db89d67d07fd813166f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.721389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0a97e94b864db89d67d07fd813166f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.722776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1b951e62-6341-47c3-8136-1f3781b8d697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0a97e94b864db89d67d07fd813166f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:52.746724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 979/1995] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:52 2022] DELETE /identity/v3/users/4e0a97e94b864db89d67d07fd813166f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:52.751305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1dffa-e4d4-4318-af79-19e0225dea97 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.751663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1dffa-e4d4-4318-af79-19e0225dea97 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.752157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1dffa-e4d4-4318-af79-19e0225dea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.807645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bcd7c-4513-407e-8150-2b37f9ada998 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:52.808958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8af1dffa-e4d4-4318-af79-19e0225dea97 None None] MFA Rules not processed for user `c8196350cbc140c8b97df914d58c9319`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:52.810034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8af1dffa-e4d4-4318-af79-19e0225dea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.826883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:52.875145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:52.875861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:52.876107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:52.876517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] PATH_INFO: `/v3/projects/8a6a076853f44f7fbbfd5bd22cfaf474/users/9df6acfbeafb4facad8007683830a760/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:52.894557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6a076853f44f7fbbfd5bd22cfaf474, user_id=9df6acfbeafb4facad8007683830a760, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:52.897082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:52.910536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 980/1996] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:52.911497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1dffa-e4d4-4318-af79-19e0225dea97 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.913023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8af1dffa-e4d4-4318-af79-19e0225dea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.917548 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1017/1997] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:52 2022] PUT /identity/v3/projects/8a6a076853f44f7fbbfd5bd22cfaf474/users/9df6acfbeafb4facad8007683830a760/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:52.917548 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:52.919785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:52.936912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1dffa-e4d4-4318-af79-19e0225dea97 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.004092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:53.010895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803f42f-b412-4979-a80e-492f590e8c3c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.018760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.019575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.019844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.020128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.020234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.020408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] PATH_INFO: `/v3/projects/52656dc8de2f4f649266459015b406c7` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.020522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.020790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.021557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.023774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.035106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52656dc8de2f4f649266459015b406c7)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.037080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.057588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1018/1998] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:52 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:53.058648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:53.060472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.139228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710d30-ec59-42a7-bddb-7d61ed0b109e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.144367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2da1-7376-4a97-bd46-4e24fa6bba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.145055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2da1-7376-4a97-bd46-4e24fa6bba9f admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.145272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2da1-7376-4a97-bd46-4e24fa6bba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.145547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2da1-7376-4a97-bd46-4e24fa6bba9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.146254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c2da1-7376-4a97-bd46-4e24fa6bba9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.148144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c2da1-7376-4a97-bd46-4e24fa6bba9f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.163007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1019/1999] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:53.164114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2da1-7376-4a97-bd46-4e24fa6bba9f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:53.174734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2da1-7376-4a97-bd46-4e24fa6bba9f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.194626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52656dc8de2f4f649266459015b406c7', 'request_id': 'req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.206761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52656dc8de2f4f649266459015b406c7', 'request_id': 'req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.226970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52656dc8de2f4f649266459015b406c7', 'request_id': 'req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.241666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] The token cache is being invalidate because project 52656dc8de2f4f649266459015b406c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:53.241974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.242620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.244059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.244788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.244902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 981/2000] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:52 2022] DELETE /identity/v3/projects/52656dc8de2f4f649266459015b406c7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:53.245297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.245666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.246433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.248746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:53.249891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.250206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.265685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defbdbf-ed4e-4111-8347-c0f28b8fbea9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.273681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.274863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.275279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.275620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] PATH_INFO: `/v3/projects/3f3508733b9d4259bb9bb36ebd72a486` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.277534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3508733b9d4259bb9bb36ebd72a486)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.280363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.285970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1020/2001] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:53 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:53.286264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:53.288711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.309657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bd61a-0e2f-48e6-957f-9f4cabbfb9e9 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.314591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.315297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.315578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.315858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] PATH_INFO: `/v3/projects/8a6a076853f44f7fbbfd5bd22cfaf474/users/9df6acfbeafb4facad8007683830a760/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.317820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6a076853f44f7fbbfd5bd22cfaf474, user_id=9df6acfbeafb4facad8007683830a760, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.321544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.345607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:53.352644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3508733b9d4259bb9bb36ebd72a486', 'request_id': 'req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.355132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1021/2002] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:53 2022] PUT /identity/v3/projects/8a6a076853f44f7fbbfd5bd22cfaf474/users/9df6acfbeafb4facad8007683830a760/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:53.358483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:53.360353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.364823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3508733b9d4259bb9bb36ebd72a486', 'request_id': 'req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.376092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3508733b9d4259bb9bb36ebd72a486', 'request_id': 'req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.389518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] The token cache is being invalidate because project 3f3508733b9d4259bb9bb36ebd72a486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:53.389955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.390710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.392805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 982/2003] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:53 2022] DELETE /identity/v3/projects/3f3508733b9d4259bb9bb36ebd72a486 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:53.393644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:53.395363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.444647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:53.450772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307039c-5784-429d-ba5b-cd3f71dcdae2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.456587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.457100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.457443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.457804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] PATH_INFO: `/v3/users/3adc3e100ee6478a869aee62124466be` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.459108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adc3e100ee6478a869aee62124466be)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.461099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.476053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887f133-abc9-4ac1-baa4-6cba0b3b8a1a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.491404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69216ca2-f0f9-4565-9f6d-0302ee4f07e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.492443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216ca2-f0f9-4565-9f6d-0302ee4f07e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.492572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216ca2-f0f9-4565-9f6d-0302ee4f07e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.493661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216ca2-f0f9-4565-9f6d-0302ee4f07e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.494678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69216ca2-f0f9-4565-9f6d-0302ee4f07e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.496413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69216ca2-f0f9-4565-9f6d-0302ee4f07e2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.517362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 983/2004] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:53.519071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761b328-98fd-4416-9d0b-d5b4e971e7ec None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.519438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761b328-98fd-4416-9d0b-d5b4e971e7ec None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.519812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761b328-98fd-4416-9d0b-d5b4e971e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.566832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adc3e100ee6478a869aee62124466be'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.586474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adc3e100ee6478a869aee62124466be'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.604111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adc3e100ee6478a869aee62124466be'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.605409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adc3e100ee6478a869aee62124466be'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.612115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f761b328-98fd-4416-9d0b-d5b4e971e7ec None None] MFA Rules not processed for user `9df6acfbeafb4facad8007683830a760`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:53.614306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f761b328-98fd-4416-9d0b-d5b4e971e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.641995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07b749bd-e0dd-4055-ba4d-1402f798b5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adc3e100ee6478a869aee62124466be'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:53.651368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1022/2005] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:53 2022] DELETE /identity/v3/users/3adc3e100ee6478a869aee62124466be => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:53.653063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955f5f-ab27-41c1-8ed1-93b5f7816ad3 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.653564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955f5f-ab27-41c1-8ed1-93b5f7816ad3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.654598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955f5f-ab27-41c1-8ed1-93b5f7816ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.704590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-84955f5f-ab27-41c1-8ed1-93b5f7816ad3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:53.708179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-84955f5f-ab27-41c1-8ed1-93b5f7816ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.710812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 984/2006] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:53.712642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761b328-98fd-4416-9d0b-d5b4e971e7ec None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:53.714312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f761b328-98fd-4416-9d0b-d5b4e971e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.741321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761b328-98fd-4416-9d0b-d5b4e971e7ec None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:53.801445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:53.832679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e98d4-9e03-41a3-8f5e-4c47185d1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:53.836222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e98d4-9e03-41a3-8f5e-4c47185d1b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.838700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e98d4-9e03-41a3-8f5e-4c47185d1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.842449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e98d4-9e03-41a3-8f5e-4c47185d1b9c admin admin] PATH_INFO: `/v3/projects/1bb6e11e36674d42998af37807c84f4c/users/680f28b58bbc45cca35e0462e74d47d6/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.887558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e98d4-9e03-41a3-8f5e-4c47185d1b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb6e11e36674d42998af37807c84f4c, user_id=680f28b58bbc45cca35e0462e74d47d6, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:53.889304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1023/2007] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:53.891124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84955f5f-ab27-41c1-8ed1-93b5f7816ad3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:53.892281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e98d4-9e03-41a3-8f5e-4c47185d1b9c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:53.894733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-84955f5f-ab27-41c1-8ed1-93b5f7816ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.923182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 985/2008] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:53 2022] PUT /identity/v3/projects/1bb6e11e36674d42998af37807c84f4c/users/680f28b58bbc45cca35e0462e74d47d6/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:53.924682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ade6-c0d0-483e-a1c6-e13ef429445e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:53.925039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ade6-c0d0-483e-a1c6-e13ef429445e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:53.925545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ade6-c0d0-483e-a1c6-e13ef429445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:53.949111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-fa75ade6-c0d0-483e-a1c6-e13ef429445e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:53.951422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-fa75ade6-c0d0-483e-a1c6-e13ef429445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:53.999765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84955f5f-ab27-41c1-8ed1-93b5f7816ad3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.036527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:54.055771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 986/2009] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:54.057068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ade6-c0d0-483e-a1c6-e13ef429445e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.063070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c807-8a22-46ba-8d16-45b726dfd84c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.063900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c807-8a22-46ba-8d16-45b726dfd84c service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.064339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c807-8a22-46ba-8d16-45b726dfd84c service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.064912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c807-8a22-46ba-8d16-45b726dfd84c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.068291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ade6-c0d0-483e-a1c6-e13ef429445e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.078152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a273f7e-4275-485c-9d1a-5af50d3abfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.078792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273f7e-4275-485c-9d1a-5af50d3abfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.079105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273f7e-4275-485c-9d1a-5af50d3abfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.079384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273f7e-4275-485c-9d1a-5af50d3abfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.080985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a273f7e-4275-485c-9d1a-5af50d3abfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.082623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a273f7e-4275-485c-9d1a-5af50d3abfd2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.112136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 987/2010] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:54.113038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a273f7e-4275-485c-9d1a-5af50d3abfd2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.123165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a273f7e-4275-485c-9d1a-5af50d3abfd2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.127999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.128620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.128907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.129186 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.129949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:54.130193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.131820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.142367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2c807-8a22-46ba-8d16-45b726dfd84c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.144030 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2c807-8a22-46ba-8d16-45b726dfd84c service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.148733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 988/2011] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:52:54.148733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.159929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74367a-f61f-413d-a2c7-21e38b23dd1a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.163858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1024/2012] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:54.164729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c807-8a22-46ba-8d16-45b726dfd84c service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.165618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49ac4-9e22-4b8a-b793-4bc7a428f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.166289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49ac4-9e22-4b8a-b793-4bc7a428f69a admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.166572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49ac4-9e22-4b8a-b793-4bc7a428f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.166845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49ac4-9e22-4b8a-b793-4bc7a428f69a admin admin] PATH_INFO: `/v3/projects/1bb6e11e36674d42998af37807c84f4c/users/680f28b58bbc45cca35e0462e74d47d6/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.169482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49ac4-9e22-4b8a-b793-4bc7a428f69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb6e11e36674d42998af37807c84f4c, user_id=680f28b58bbc45cca35e0462e74d47d6, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.172790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49ac4-9e22-4b8a-b793-4bc7a428f69a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.184418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 989/2013] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:54 2022] PUT /identity/v3/projects/1bb6e11e36674d42998af37807c84f4c/users/680f28b58bbc45cca35e0462e74d47d6/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:54.195649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e029f-b24e-4ac7-8b24-501e61aab48e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.196963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e029f-b24e-4ac7-8b24-501e61aab48e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.196963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e029f-b24e-4ac7-8b24-501e61aab48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.198000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c807-8a22-46ba-8d16-45b726dfd84c service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.245792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-730e029f-b24e-4ac7-8b24-501e61aab48e None None] MFA Rules not processed for user `680f28b58bbc45cca35e0462e74d47d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:54.247677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-730e029f-b24e-4ac7-8b24-501e61aab48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:54.289722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1630f-7a52-4ba9-8f95-8a0d50e87d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.289722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1630f-7a52-4ba9-8f95-8a0d50e87d62 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.289722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1630f-7a52-4ba9-8f95-8a0d50e87d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.289722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1630f-7a52-4ba9-8f95-8a0d50e87d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.290576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1630f-7a52-4ba9-8f95-8a0d50e87d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.299597 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1630f-7a52-4ba9-8f95-8a0d50e87d62 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.365373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 990/2014] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:54.366434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e029f-b24e-4ac7-8b24-501e61aab48e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.368255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-730e029f-b24e-4ac7-8b24-501e61aab48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:54.372090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1025/2015] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:54 2022] POST /identity/v3/projects => generated 409 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:54.375993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1630f-7a52-4ba9-8f95-8a0d50e87d62 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.392244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e029f-b24e-4ac7-8b24-501e61aab48e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.417225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:54.479231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.479906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.480285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.480568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] PATH_INFO: `/v3/projects/e4bf66ba98924daa9f151c7e9a701190` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.482419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4bf66ba98924daa9f151c7e9a701190)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.490760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.514552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1630f-7a52-4ba9-8f95-8a0d50e87d62 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.532668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.533388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.533782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.534091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.534982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.537026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.551655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:54.574762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4bf66ba98924daa9f151c7e9a701190', 'request_id': 'req-ce25bb1e-c05e-4ae0-b961-af6d6240c941'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.577990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1026/2016] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:54 2022] POST /identity/v3/users => generated 305 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:54.577990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.581763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:54.596895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4bf66ba98924daa9f151c7e9a701190', 'request_id': 'req-ce25bb1e-c05e-4ae0-b961-af6d6240c941'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.606291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4bf66ba98924daa9f151c7e9a701190', 'request_id': 'req-ce25bb1e-c05e-4ae0-b961-af6d6240c941'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.625866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] The token cache is being invalidate because project e4bf66ba98924daa9f151c7e9a701190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:54.626311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.627215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.634046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 991/2017] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:54 2022] DELETE /identity/v3/projects/e4bf66ba98924daa9f151c7e9a701190 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:54.635180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.636693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:54.651830 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66818aa-7f56-4d5c-8d5a-e87ea928dd5d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.711958 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.712578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.712860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.713134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.715022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:54.719620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25bb1e-c05e-4ae0-b961-af6d6240c941 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.725129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.725838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.726164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.726442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.727218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.728814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.742560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 992/2018] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:54.742560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.745127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:54.759912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721cdb-1c9c-4e6d-b16f-cf786d052dcc admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.766026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.766697 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.767079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.767427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] PATH_INFO: `/v3/users/c3b2c13893b14ff4bf5740210bc8eced` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.768690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b2c13893b14ff4bf5740210bc8eced)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.770677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.791955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.793467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.802986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1027/2019] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:54.804269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.818079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f3c93-eb29-4d62-b271-a7cc5efe8126 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.824565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df65dd-92ae-422e-b2ce-f074b9eec4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.825274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df65dd-92ae-422e-b2ce-f074b9eec4ec admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.825612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df65dd-92ae-422e-b2ce-f074b9eec4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.825886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df65dd-92ae-422e-b2ce-f074b9eec4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.826697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df65dd-92ae-422e-b2ce-f074b9eec4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.828546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df65dd-92ae-422e-b2ce-f074b9eec4ec admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.840130 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:54.840345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1028/2020] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:54.845167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df65dd-92ae-422e-b2ce-f074b9eec4ec admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:54.855425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b2c13893b14ff4bf5740210bc8eced'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.864507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b2c13893b14ff4bf5740210bc8eced'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.865498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b2c13893b14ff4bf5740210bc8eced'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.866203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df65dd-92ae-422e-b2ce-f074b9eec4ec admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:54.875586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:54.876469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.876821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.877430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] PATH_INFO: `/v3/projects/dedd859766b8481ea4a712b3b8e98551/users/e1cc4e5238d047d791d63705e436274b/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.881352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b2c13893b14ff4bf5740210bc8eced'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.882308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-13e8d2ed-835a-4889-9805-1fd267e0caa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b2c13893b14ff4bf5740210bc8eced'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:54.905945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 993/2021] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:54 2022] DELETE /identity/v3/users/c3b2c13893b14ff4bf5740210bc8eced => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:54.906638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dedd859766b8481ea4a712b3b8e98551, user_id=e1cc4e5238d047d791d63705e436274b, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:54.909978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:54.931369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1029/2022] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:54 2022] PUT /identity/v3/projects/dedd859766b8481ea4a712b3b8e98551/users/e1cc4e5238d047d791d63705e436274b/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:54.941917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423f9a-9109-4d45-a7ea-65ca6abe4d68 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:54.942294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423f9a-9109-4d45-a7ea-65ca6abe4d68 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:54.942756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423f9a-9109-4d45-a7ea-65ca6abe4d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:54.981394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ab423f9a-9109-4d45-a7ea-65ca6abe4d68 None None] MFA Rules not processed for user `e1cc4e5238d047d791d63705e436274b`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:54.983491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ab423f9a-9109-4d45-a7ea-65ca6abe4d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:55.091381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 994/2023] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:55.095964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:55.098437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:55.143328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:55.225181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271580fb-bcea-4f07-86a1-c65b0699c932 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:55.246015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fe12d-4668-4c56-ab67-efe89467556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:55.251014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fe12d-4668-4c56-ab67-efe89467556d admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:55.255246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fe12d-4668-4c56-ab67-efe89467556d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:55.255684 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fe12d-4668-4c56-ab67-efe89467556d admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:55.256516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fe12d-4668-4c56-ab67-efe89467556d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:55.258791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fe12d-4668-4c56-ab67-efe89467556d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:55.344719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab423f9a-9109-4d45-a7ea-65ca6abe4d68 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:55.346186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1030/2024] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:55 2022] POST /identity/v3/projects => generated 409 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:55.362712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab423f9a-9109-4d45-a7ea-65ca6abe4d68 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:55.509121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:55.510055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:55.511556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:55.512027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:55.513168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:55.515299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:55.546308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 995/2025] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:55 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:55.550051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fe12d-4668-4c56-ab67-efe89467556d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:55.572385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fe12d-4668-4c56-ab67-efe89467556d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:55.577203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72895f88-d0ac-4e4b-8fb2-e4b834e5a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:55.578284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72895f88-d0ac-4e4b-8fb2-e4b834e5a46e admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:55.578284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72895f88-d0ac-4e4b-8fb2-e4b834e5a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:55.578474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72895f88-d0ac-4e4b-8fb2-e4b834e5a46e admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:55.579270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72895f88-d0ac-4e4b-8fb2-e4b834e5a46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:55.581015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72895f88-d0ac-4e4b-8fb2-e4b834e5a46e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:55.599161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:55.601658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:55.615309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1031/2026] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:55.616266 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72895f88-d0ac-4e4b-8fb2-e4b834e5a46e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:55.636866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72895f88-d0ac-4e4b-8fb2-e4b834e5a46e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:55.646248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0cf81-b687-4eef-8172-d18a58f188e7 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:55.659801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b019-b646-449b-b15a-a0e6d24bda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:55.660499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b019-b646-449b-b15a-a0e6d24bda6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:55.660780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b019-b646-449b-b15a-a0e6d24bda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:55.661058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b019-b646-449b-b15a-a0e6d24bda6b admin admin] PATH_INFO: `/v3/projects/0a0eb36f7b6a4f0986b8285dcfe86379/users/20aac444d016464b956949955b9f3558/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:55.663306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:55.663969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:55.664378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:55.664571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] PATH_INFO: `/v3/projects/c06585bba5084353a9ba8cd4d546bc47` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:55.670233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06585bba5084353a9ba8cd4d546bc47)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:55.670233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:55.695135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7b019-b646-449b-b15a-a0e6d24bda6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0eb36f7b6a4f0986b8285dcfe86379, user_id=20aac444d016464b956949955b9f3558, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:55.696793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7b019-b646-449b-b15a-a0e6d24bda6b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:55.730446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1032/2027] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:55 2022] PUT /identity/v3/projects/0a0eb36f7b6a4f0986b8285dcfe86379/users/20aac444d016464b956949955b9f3558/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:55.734115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b019-b646-449b-b15a-a0e6d24bda6b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:55.737541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:55.754601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06585bba5084353a9ba8cd4d546bc47', 'request_id': 'req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:55.765723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06585bba5084353a9ba8cd4d546bc47', 'request_id': 'req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:55.780627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06585bba5084353a9ba8cd4d546bc47', 'request_id': 'req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:55.801284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] The token cache is being invalidate because project c06585bba5084353a9ba8cd4d546bc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:55.801587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:55.803952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a8a61291-1eb5-46d7-9d9e-f3020e1ffce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:55.806503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 996/2028] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:55 2022] DELETE /identity/v3/projects/c06585bba5084353a9ba8cd4d546bc47 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:52:55.816725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321065-b422-445f-bcc7-4d297d3df3c2 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:55.817062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321065-b422-445f-bcc7-4d297d3df3c2 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:55.817348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321065-b422-445f-bcc7-4d297d3df3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:55.866691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a0321065-b422-445f-bcc7-4d297d3df3c2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:55.868006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a0321065-b422-445f-bcc7-4d297d3df3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:55.893550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b019-b646-449b-b15a-a0e6d24bda6b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:55.982991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 997/2029] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:56.007694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68da28-88c2-4d73-9964-101b7e8f830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.008938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68da28-88c2-4d73-9964-101b7e8f830f admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.009221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68da28-88c2-4d73-9964-101b7e8f830f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.009495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68da28-88c2-4d73-9964-101b7e8f830f admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.011103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68da28-88c2-4d73-9964-101b7e8f830f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.013602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68da28-88c2-4d73-9964-101b7e8f830f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.027261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1033/2030] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:56.031784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0321065-b422-445f-bcc7-4d297d3df3c2 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.033535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a0321065-b422-445f-bcc7-4d297d3df3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.048560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0321065-b422-445f-bcc7-4d297d3df3c2 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.054913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29f297-1ab8-48bf-93b0-cf77e20ce5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.056772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f297-1ab8-48bf-93b0-cf77e20ce5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.057176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f297-1ab8-48bf-93b0-cf77e20ce5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.057568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29f297-1ab8-48bf-93b0-cf77e20ce5d6 admin admin] PATH_INFO: `/v3/projects/0a0eb36f7b6a4f0986b8285dcfe86379/users/20aac444d016464b956949955b9f3558/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.060171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29f297-1ab8-48bf-93b0-cf77e20ce5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0eb36f7b6a4f0986b8285dcfe86379, user_id=20aac444d016464b956949955b9f3558, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.060581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51a862-5dcb-4c3e-9fb2-80c94afdf826 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.061171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51a862-5dcb-4c3e-9fb2-80c94afdf826 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.061800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51a862-5dcb-4c3e-9fb2-80c94afdf826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.062853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29f297-1ab8-48bf-93b0-cf77e20ce5d6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.086764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 998/2031] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:56 2022] PUT /identity/v3/projects/0a0eb36f7b6a4f0986b8285dcfe86379/users/20aac444d016464b956949955b9f3558/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:56.089640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00565ae-a805-4515-b81f-1979d0d63f92 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.090589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00565ae-a805-4515-b81f-1979d0d63f92 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.091061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00565ae-a805-4515-b81f-1979d0d63f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.094162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-dd51a862-5dcb-4c3e-9fb2-80c94afdf826 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:56.095451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dd51a862-5dcb-4c3e-9fb2-80c94afdf826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.118656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:56.131646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e00565ae-a805-4515-b81f-1979d0d63f92 None None] MFA Rules not processed for user `20aac444d016464b956949955b9f3558`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:56.133366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e00565ae-a805-4515-b81f-1979d0d63f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.165273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1034/2032] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:56.169613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51a862-5dcb-4c3e-9fb2-80c94afdf826 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.182401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51a862-5dcb-4c3e-9fb2-80c94afdf826 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.188493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.189171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.189451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.189724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.190490 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:56.190781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.193133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.210390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1035/2033] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:52:56.216157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.240338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4468d21-37af-423e-bd61-87186f62e50d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.249046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 999/2034] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:56 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:52:56.257022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40f1e0-a093-40b9-a7e1-540d565fc090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.257741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f1e0-a093-40b9-a7e1-540d565fc090 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.258090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f1e0-a093-40b9-a7e1-540d565fc090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.259039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f1e0-a093-40b9-a7e1-540d565fc090 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.259786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40f1e0-a093-40b9-a7e1-540d565fc090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.261221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00565ae-a805-4515-b81f-1979d0d63f92 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.264645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e00565ae-a805-4515-b81f-1979d0d63f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.266516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40f1e0-a093-40b9-a7e1-540d565fc090 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.319774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:56.343166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1036/2035] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:56 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:56.349648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40f1e0-a093-40b9-a7e1-540d565fc090 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.352863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00565ae-a805-4515-b81f-1979d0d63f92 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.413908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af581-c751-412b-bed2-10b6399decc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.415502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af581-c751-412b-bed2-10b6399decc2 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.415625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af581-c751-412b-bed2-10b6399decc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.415981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af581-c751-412b-bed2-10b6399decc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.440644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40f1e0-a093-40b9-a7e1-540d565fc090 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.446598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.447281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.447566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.447898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.449085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.451902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.495852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1037/2036] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:56 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:56.496981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.501161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.502457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254af581-c751-412b-bed2-10b6399decc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.503934 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254af581-c751-412b-bed2-10b6399decc2 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.520399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3b23a-1431-48b8-94cc-d182e615337c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.525471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.526127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.526373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.526647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] PATH_INFO: `/v3/users/41a3af1c41d34873b5d05d5f86d64128` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.527893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a3af1c41d34873b5d05d5f86d64128)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.529959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.542993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1000/2037] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:56 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:56.544069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af581-c751-412b-bed2-10b6399decc2 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.560922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af581-c751-412b-bed2-10b6399decc2 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.566294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4189-cb94-4c6f-93d9-ce165acbeeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.567363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4189-cb94-4c6f-93d9-ce165acbeeca admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.568018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4189-cb94-4c6f-93d9-ce165acbeeca admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.568397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4189-cb94-4c6f-93d9-ce165acbeeca admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.569110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d4189-cb94-4c6f-93d9-ce165acbeeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.571034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d4189-cb94-4c6f-93d9-ce165acbeeca admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.581915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1001/2038] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:56.585872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4189-cb94-4c6f-93d9-ce165acbeeca admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.598422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4189-cb94-4c6f-93d9-ce165acbeeca admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.605076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b927fc3-f060-4236-84e6-ec68cbd4dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.605815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927fc3-f060-4236-84e6-ec68cbd4dcbc admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.606196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927fc3-f060-4236-84e6-ec68cbd4dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.606589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927fc3-f060-4236-84e6-ec68cbd4dcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.607562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b927fc3-f060-4236-84e6-ec68cbd4dcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.609644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b927fc3-f060-4236-84e6-ec68cbd4dcbc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.630389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1002/2039] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:52:56.638812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b927fc3-f060-4236-84e6-ec68cbd4dcbc admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.658288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a3af1c41d34873b5d05d5f86d64128'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:56.665450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b927fc3-f060-4236-84e6-ec68cbd4dcbc admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.672282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76f27a-7f42-47b1-a297-a60276a24e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.672710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a3af1c41d34873b5d05d5f86d64128'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:56.673185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76f27a-7f42-47b1-a297-a60276a24e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.673473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76f27a-7f42-47b1-a297-a60276a24e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.673756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76f27a-7f42-47b1-a297-a60276a24e86 admin admin] PATH_INFO: `/v3/projects/e78891a3061047f885af8f25b296a09f/users/6daa9d3223764374bc5fc76387d07355/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.684074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a3af1c41d34873b5d05d5f86d64128'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:56.685145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a3af1c41d34873b5d05d5f86d64128'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:56.695165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76f27a-7f42-47b1-a297-a60276a24e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78891a3061047f885af8f25b296a09f, user_id=6daa9d3223764374bc5fc76387d07355, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.697728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:56.701458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76f27a-7f42-47b1-a297-a60276a24e86 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.709550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a3af1c41d34873b5d05d5f86d64128'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:56.719292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1038/2040] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:56 2022] DELETE /identity/v3/users/41a3af1c41d34873b5d05d5f86d64128 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:56.723452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.724914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.739166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1003/2041] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:56 2022] PUT /identity/v3/projects/e78891a3061047f885af8f25b296a09f/users/6daa9d3223764374bc5fc76387d07355/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:56.739166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157785d2-cc7b-43c5-bb52-e64620876087 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.739166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157785d2-cc7b-43c5-bb52-e64620876087 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.739166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157785d2-cc7b-43c5-bb52-e64620876087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.764698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-157785d2-cc7b-43c5-bb52-e64620876087 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:56.766356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-157785d2-cc7b-43c5-bb52-e64620876087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.816258 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf43ae-c046-42fb-8176-28f5377ae784 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.832860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:56.855201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1004/2042] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:56.856514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a28e1-d1b7-4b86-94cc-0ab4d5f50a3a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.856865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a28e1-d1b7-4b86-94cc-0ab4d5f50a3a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.857331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a28e1-d1b7-4b86-94cc-0ab4d5f50a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.871187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.871809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.872094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.872373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.874146 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.885217 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5b1a28e1-d1b7-4b86-94cc-0ab4d5f50a3a None None] MFA Rules not processed for user `6daa9d3223764374bc5fc76387d07355`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:56.886480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5b1a28e1-d1b7-4b86-94cc-0ab4d5f50a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.932969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:56.934668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:56.943837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1039/2043] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:56.944767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.946191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.953303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1005/2044] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:56.958229 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86446f98-e5d1-4bb3-aeb6-230ba5b2a21b service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:56.962574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a28e1-d1b7-4b86-94cc-0ab4d5f50a3a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:56.964568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:56.965425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:56.965810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:56.966186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:56.966307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5b1a28e1-d1b7-4b86-94cc-0ab4d5f50a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:56.968304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:57.042995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a28e1-d1b7-4b86-94cc-0ab4d5f50a3a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:57.043307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:57.045792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:57.047914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:57.048595 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:57.048884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:57.049319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:57.054130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:57.064893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1040/2045] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:57.067634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:57.070102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:57.086453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1006/2046] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:52:57.423094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:57.433078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61d31-3ac9-4f7c-9195-6c0eb937d5fa service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:57.450966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be11daf-6fcf-415c-818f-2eeefa7f95b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:57.450966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11daf-6fcf-415c-818f-2eeefa7f95b5 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:57.450966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11daf-6fcf-415c-818f-2eeefa7f95b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:57.450966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11daf-6fcf-415c-818f-2eeefa7f95b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:57.466474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be11daf-6fcf-415c-818f-2eeefa7f95b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:57.468613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be11daf-6fcf-415c-818f-2eeefa7f95b5 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:57.481506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1041/2047] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:57.746051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:57.752215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:57.787799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95571f5-e90f-4bed-aa1a-a3e490bf4bde service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:57.801932 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be11daf-6fcf-415c-818f-2eeefa7f95b5 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:57.805672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:57.806789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:57.807111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:57.807396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] PATH_INFO: `/v3/projects/fef866767c4344a4beec046608cf3271` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:57.810958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef866767c4344a4beec046608cf3271)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:57.812023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:57.832608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be11daf-6fcf-415c-818f-2eeefa7f95b5 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:57.846207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:57.846450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:57.846729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:57.847776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:57.853773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:57.933414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef866767c4344a4beec046608cf3271', 'request_id': 'req-34a115b4-05ac-4097-a6ac-437a674fce7b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:57.938464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef866767c4344a4beec046608cf3271', 'request_id': 'req-34a115b4-05ac-4097-a6ac-437a674fce7b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:57.953717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef866767c4344a4beec046608cf3271', 'request_id': 'req-34a115b4-05ac-4097-a6ac-437a674fce7b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:57.982242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] The token cache is being invalidate because project fef866767c4344a4beec046608cf3271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:57.982810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:57.983674 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:57.990947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1007/2048] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:57 2022] DELETE /identity/v3/projects/fef866767c4344a4beec046608cf3271 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:57.994961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:57.997984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:58.032598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:58.061533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:58.063029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:58.080806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1042/2049] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:52:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:52:58.181770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a115b4-05ac-4097-a6ac-437a674fce7b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:58.187450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:58.188379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:58.188819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:58.189251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] PATH_INFO: `/v3/users/9df6acfbeafb4facad8007683830a760` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:58.190714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df6acfbeafb4facad8007683830a760)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:58.193197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:58.283619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df6acfbeafb4facad8007683830a760'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.303610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df6acfbeafb4facad8007683830a760'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.305746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df6acfbeafb4facad8007683830a760'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.324804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df6acfbeafb4facad8007683830a760'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.325742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7d66b95b-aa7d-4a60-b927-0a467a6e97d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df6acfbeafb4facad8007683830a760'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.341371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1008/2050] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:52:57 2022] DELETE /identity/v3/users/9df6acfbeafb4facad8007683830a760 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:58.656417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:58.677281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d018dd5-580d-4b30-b7dd-a5fd56bb237a service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:58.780107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:58.780791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:58.781248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:58.781528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] PATH_INFO: `/v3/projects/8a6a076853f44f7fbbfd5bd22cfaf474` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:58.782850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6a076853f44f7fbbfd5bd22cfaf474)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:58.784941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:58.838529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6a076853f44f7fbbfd5bd22cfaf474', 'request_id': 'req-28231319-f07b-4f9b-a02f-aff9a8735aa4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.847334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6a076853f44f7fbbfd5bd22cfaf474', 'request_id': 'req-28231319-f07b-4f9b-a02f-aff9a8735aa4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.866849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6a076853f44f7fbbfd5bd22cfaf474', 'request_id': 'req-28231319-f07b-4f9b-a02f-aff9a8735aa4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.885428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] The token cache is being invalidate because project 8a6a076853f44f7fbbfd5bd22cfaf474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:52:58.885742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.886725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-28231319-f07b-4f9b-a02f-aff9a8735aa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:52:58.889413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1043/2051] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:52:58 2022] DELETE /identity/v3/projects/8a6a076853f44f7fbbfd5bd22cfaf474 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:58.900582 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f798-d39c-4c62-8f3f-f35c3906b941 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:58.901748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f798-d39c-4c62-8f3f-f35c3906b941 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:58.902213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7f798-d39c-4c62-8f3f-f35c3906b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:58.946748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-6da7f798-d39c-4c62-8f3f-f35c3906b941 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:58.948515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6da7f798-d39c-4c62-8f3f-f35c3906b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:59.025109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1009/2052] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:59.034063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264d436-b839-4985-9f1b-47094afcf3f4 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.034392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264d436-b839-4985-9f1b-47094afcf3f4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.034673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264d436-b839-4985-9f1b-47094afcf3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.056625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-e264d436-b839-4985-9f1b-47094afcf3f4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:59.057851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e264d436-b839-4985-9f1b-47094afcf3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:59.072082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1044/2053] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:59.076531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7f798-d39c-4c62-8f3f-f35c3906b941 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.087249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7f798-d39c-4c62-8f3f-f35c3906b941 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.094317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.094974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.095272 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.095554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.096391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:52:59.096709 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.098630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.116311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1010/2054] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:52:59.117516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264d436-b839-4985-9f1b-47094afcf3f4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.124111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:59.129027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264d436-b839-4985-9f1b-47094afcf3f4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.139563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c94c3-3ce7-4ece-9d21-49e654671316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.140369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c94c3-3ce7-4ece-9d21-49e654671316 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.140820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c94c3-3ce7-4ece-9d21-49e654671316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.141271 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c94c3-3ce7-4ece-9d21-49e654671316 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.141953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c94c3-3ce7-4ece-9d21-49e654671316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.143961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c94c3-3ce7-4ece-9d21-49e654671316 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.180304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1045/2055] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:59 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:59.181017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.191179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385960f2-312e-4a8d-b420-21e5538eb9f2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.205866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:52:59.264794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d0b8-38d9-4b29-bd60-42c0ca980d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.265868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d0b8-38d9-4b29-bd60-42c0ca980d08 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.266284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d0b8-38d9-4b29-bd60-42c0ca980d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.266706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d0b8-38d9-4b29-bd60-42c0ca980d08 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.267693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758d0b8-38d9-4b29-bd60-42c0ca980d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.269777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758d0b8-38d9-4b29-bd60-42c0ca980d08 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.296897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1011/2056] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:59 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:59.301204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c94c3-3ce7-4ece-9d21-49e654671316 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.333516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c94c3-3ce7-4ece-9d21-49e654671316 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.354194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf1a7-1eb4-48cc-ba9c-acd51f240635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.354843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf1a7-1eb4-48cc-ba9c-acd51f240635 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.355162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf1a7-1eb4-48cc-ba9c-acd51f240635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.355445 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf1a7-1eb4-48cc-ba9c-acd51f240635 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.356227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcf1a7-1eb4-48cc-ba9c-acd51f240635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.358190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcf1a7-1eb4-48cc-ba9c-acd51f240635 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.373295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1046/2057] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:59.374524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d0b8-38d9-4b29-bd60-42c0ca980d08 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.396183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d0b8-38d9-4b29-bd60-42c0ca980d08 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.403561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2a84b-4ee6-471a-99ac-6a423bcbc68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.404627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a84b-4ee6-471a-99ac-6a423bcbc68e admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.405092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a84b-4ee6-471a-99ac-6a423bcbc68e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.405504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2a84b-4ee6-471a-99ac-6a423bcbc68e admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.406480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2a84b-4ee6-471a-99ac-6a423bcbc68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.408453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2a84b-4ee6-471a-99ac-6a423bcbc68e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.431527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf1a7-1eb4-48cc-ba9c-acd51f240635 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.433052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1012/2058] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:59.447741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf1a7-1eb4-48cc-ba9c-acd51f240635 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.454181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e159-3d35-4727-b7d6-f05ff3b15a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.455867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e159-3d35-4727-b7d6-f05ff3b15a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.456272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e159-3d35-4727-b7d6-f05ff3b15a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.456660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e159-3d35-4727-b7d6-f05ff3b15a92 admin admin] PATH_INFO: `/v3/projects/687bf64e685a477aac314b0192ca7e4f/users/4502c5e780cc492ca88167e9d178a532/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.477778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e159-3d35-4727-b7d6-f05ff3b15a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687bf64e685a477aac314b0192ca7e4f, user_id=4502c5e780cc492ca88167e9d178a532, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.480784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e159-3d35-4727-b7d6-f05ff3b15a92 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.502222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1047/2059] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:59 2022] PUT /identity/v3/projects/687bf64e685a477aac314b0192ca7e4f/users/4502c5e780cc492ca88167e9d178a532/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:52:59.514540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c23e-1408-4aa5-8d77-e19d873d8b34 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.515111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c23e-1408-4aa5-8d77-e19d873d8b34 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.515456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c23e-1408-4aa5-8d77-e19d873d8b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.556126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9771c23e-1408-4aa5-8d77-e19d873d8b34 None None] MFA Rules not processed for user `4502c5e780cc492ca88167e9d178a532`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:52:59.557604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9771c23e-1408-4aa5-8d77-e19d873d8b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:52:59.704565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1013/2060] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:52:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:52:59.709311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e159-3d35-4727-b7d6-f05ff3b15a92 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.804906 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e159-3d35-4727-b7d6-f05ff3b15a92 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.811687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bc59b-5231-4c94-bd77-40a88ae5bc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.812429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc59b-5231-4c94-bd77-40a88ae5bc52 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.812740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc59b-5231-4c94-bd77-40a88ae5bc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.812992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc59b-5231-4c94-bd77-40a88ae5bc52 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.813665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bc59b-5231-4c94-bd77-40a88ae5bc52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.815625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bc59b-5231-4c94-bd77-40a88ae5bc52 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.862971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1048/2061] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:52:59 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:59.868067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c23e-1408-4aa5-8d77-e19d873d8b34 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.880839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c23e-1408-4aa5-8d77-e19d873d8b34 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.936488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f865f-e8fc-4bff-bcf1-0eb448d28293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.937123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f865f-e8fc-4bff-bcf1-0eb448d28293 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.937379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f865f-e8fc-4bff-bcf1-0eb448d28293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.937647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f865f-e8fc-4bff-bcf1-0eb448d28293 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.938307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f865f-e8fc-4bff-bcf1-0eb448d28293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.940237 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f865f-e8fc-4bff-bcf1-0eb448d28293 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.960702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1014/2062] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:52:59 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:52:59.965039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bc59b-5231-4c94-bd77-40a88ae5bc52 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:52:59.975505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bc59b-5231-4c94-bd77-40a88ae5bc52 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:52:59.980114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44bf83-1ade-4a8f-900a-b0b909420f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:52:59.980720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44bf83-1ade-4a8f-900a-b0b909420f56 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:52:59.981006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44bf83-1ade-4a8f-900a-b0b909420f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:52:59.981282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44bf83-1ade-4a8f-900a-b0b909420f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:52:59.981977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44bf83-1ade-4a8f-900a-b0b909420f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:52:59.983603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44bf83-1ade-4a8f-900a-b0b909420f56 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:52:59.994508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1049/2063] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:52:59.998465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f865f-e8fc-4bff-bcf1-0eb448d28293 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:00.008826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f865f-e8fc-4bff-bcf1-0eb448d28293 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:00.013950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0dcdd-2cf6-42a4-bcda-3831e0d1064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:00.014661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0dcdd-2cf6-42a4-bcda-3831e0d1064c admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:00.015037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0dcdd-2cf6-42a4-bcda-3831e0d1064c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:00.015244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0dcdd-2cf6-42a4-bcda-3831e0d1064c admin admin] PATH_INFO: `/v3/projects/acd0d32a89e44b1da177ee6c8a874fff/users/057d1fdfa95e4b84ae3789fc419bfd09/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:00.027303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:00.036453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0dcdd-2cf6-42a4-bcda-3831e0d1064c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd0d32a89e44b1da177ee6c8a874fff, user_id=057d1fdfa95e4b84ae3789fc419bfd09, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:00.039152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0dcdd-2cf6-42a4-bcda-3831e0d1064c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:00.051659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1015/2064] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:52:59 2022] PUT /identity/v3/projects/acd0d32a89e44b1da177ee6c8a874fff/users/057d1fdfa95e4b84ae3789fc419bfd09/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:00.056089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44bf83-1ade-4a8f-900a-b0b909420f56 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:00.066163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44bf83-1ade-4a8f-900a-b0b909420f56 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:00.125729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2652c-2dcd-4776-a967-75ee206ad0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:00.126339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2652c-2dcd-4776-a967-75ee206ad0ec admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:00.126646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2652c-2dcd-4776-a967-75ee206ad0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:00.126950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2652c-2dcd-4776-a967-75ee206ad0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:00.127630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2652c-2dcd-4776-a967-75ee206ad0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:00.129264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2652c-2dcd-4776-a967-75ee206ad0ec admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:00.139534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1050/2065] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:00.143731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0dcdd-2cf6-42a4-bcda-3831e0d1064c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:00.153928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0dcdd-2cf6-42a4-bcda-3831e0d1064c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:00.158597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:00.159306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:00.159577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:00.159855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] PATH_INFO: `/v3/projects/acd0d32a89e44b1da177ee6c8a874fff/users/057d1fdfa95e4b84ae3789fc419bfd09/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:00.161800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd0d32a89e44b1da177ee6c8a874fff, user_id=057d1fdfa95e4b84ae3789fc419bfd09, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:00.164930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:00.175019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1016/2066] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:00 2022] PUT /identity/v3/projects/acd0d32a89e44b1da177ee6c8a874fff/users/057d1fdfa95e4b84ae3789fc419bfd09/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:00.185671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6c29-cc0c-4000-aaf4-76de0706411f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:00.185984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6c29-cc0c-4000-aaf4-76de0706411f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:00.186265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a6c29-cc0c-4000-aaf4-76de0706411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:00.213648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a81a6c29-cc0c-4000-aaf4-76de0706411f None None] MFA Rules not processed for user `057d1fdfa95e4b84ae3789fc419bfd09`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:00.214841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a81a6c29-cc0c-4000-aaf4-76de0706411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:00.219824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:00.283115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1051/2067] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:53:00.294697 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:00.296404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:00.352652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ad56-d62e-41d7-b764-6c0c6816f90e admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:00.356295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c9b48-a7f1-4fbf-8435-2d5a3f0d2076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:00.356915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9b48-a7f1-4fbf-8435-2d5a3f0d2076 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:00.357195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9b48-a7f1-4fbf-8435-2d5a3f0d2076 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:00.357474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9b48-a7f1-4fbf-8435-2d5a3f0d2076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:00.366668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9b48-a7f1-4fbf-8435-2d5a3f0d2076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:00.368766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9b48-a7f1-4fbf-8435-2d5a3f0d2076 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:00.378265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1017/2068] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:00.409349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a6c29-cc0c-4000-aaf4-76de0706411f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:00.471078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a6c29-cc0c-4000-aaf4-76de0706411f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:00.475653 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:00.476278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:00.476558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:00.476831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] PATH_INFO: `/v3/users/4502c5e780cc492ca88167e9d178a532` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:00.478657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4502c5e780cc492ca88167e9d178a532)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:00.480613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:00.525828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4502c5e780cc492ca88167e9d178a532'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:00.532863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4502c5e780cc492ca88167e9d178a532'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:00.540255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4502c5e780cc492ca88167e9d178a532'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:00.540902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4502c5e780cc492ca88167e9d178a532'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:00.552625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4502c5e780cc492ca88167e9d178a532'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:00.559019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1052/2069] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:00 2022] DELETE /identity/v3/users/4502c5e780cc492ca88167e9d178a532 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:00.563471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d1c0-f246-44f3-81ba-dc8df6e78530 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:00.563763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d1c0-f246-44f3-81ba-dc8df6e78530 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:00.564046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d1c0-f246-44f3-81ba-dc8df6e78530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:00.582390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-efa5d1c0-f246-44f3-81ba-dc8df6e78530 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:00.583627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-efa5d1c0-f246-44f3-81ba-dc8df6e78530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:00.645531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1018/2070] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:00.655651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:00.657063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:00.687276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:00.731256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d2d85-bd97-4eab-9b59-9f74662eabd6 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:00.745833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c84a6-7a50-4b85-96d1-41337ab6a713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:00.746569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c84a6-7a50-4b85-96d1-41337ab6a713 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:00.746852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c84a6-7a50-4b85-96d1-41337ab6a713 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:00.747154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c84a6-7a50-4b85-96d1-41337ab6a713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:00.756798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c84a6-7a50-4b85-96d1-41337ab6a713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:00.758506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c84a6-7a50-4b85-96d1-41337ab6a713 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:00.769021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1053/2071] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:53:01.123720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d1c0-f246-44f3-81ba-dc8df6e78530 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:01.125244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-efa5d1c0-f246-44f3-81ba-dc8df6e78530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:01.138640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d1c0-f246-44f3-81ba-dc8df6e78530 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:01.143568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:01.144305 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:01.144686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:01.145034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] PATH_INFO: `/v3/projects/687bf64e685a477aac314b0192ca7e4f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:01.146302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687bf64e685a477aac314b0192ca7e4f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:01.148330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:01.196754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687bf64e685a477aac314b0192ca7e4f', 'request_id': 'req-c700323e-d229-4543-b718-34bc6190ec38'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.202901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687bf64e685a477aac314b0192ca7e4f', 'request_id': 'req-c700323e-d229-4543-b718-34bc6190ec38'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.210063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687bf64e685a477aac314b0192ca7e4f', 'request_id': 'req-c700323e-d229-4543-b718-34bc6190ec38'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.221056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] The token cache is being invalidate because project 687bf64e685a477aac314b0192ca7e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:01.221348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.221982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.223556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1019/2072] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:01 2022] DELETE /identity/v3/projects/687bf64e685a477aac314b0192ca7e4f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:01.227560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c84a6-7a50-4b85-96d1-41337ab6a713 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:01.237235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c84a6-7a50-4b85-96d1-41337ab6a713 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:01.292749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:01.293384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:01.293667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:01.293946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] PATH_INFO: `/v3/users/057d1fdfa95e4b84ae3789fc419bfd09` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:01.295133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=057d1fdfa95e4b84ae3789fc419bfd09)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:01.297043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:01.342137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057d1fdfa95e4b84ae3789fc419bfd09'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.349013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057d1fdfa95e4b84ae3789fc419bfd09'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.355857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057d1fdfa95e4b84ae3789fc419bfd09'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.356479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057d1fdfa95e4b84ae3789fc419bfd09'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.368663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-47aaef1b-8f6d-4cf9-83fe-eaa95e95c940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057d1fdfa95e4b84ae3789fc419bfd09'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.374611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1054/2073] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:01 2022] DELETE /identity/v3/users/057d1fdfa95e4b84ae3789fc419bfd09 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:01.649912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:01.651377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:01.659909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:01.671693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700323e-d229-4543-b718-34bc6190ec38 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:01.728335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:01.728983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:01.729266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:01.729541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] PATH_INFO: `/v3/projects/acd0d32a89e44b1da177ee6c8a874fff` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:01.730709 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd0d32a89e44b1da177ee6c8a874fff)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:01.732666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:01.783446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd0d32a89e44b1da177ee6c8a874fff', 'request_id': 'req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.790465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd0d32a89e44b1da177ee6c8a874fff', 'request_id': 'req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.804854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd0d32a89e44b1da177ee6c8a874fff', 'request_id': 'req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.819472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] The token cache is being invalidate because project acd0d32a89e44b1da177ee6c8a874fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:01.819770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.820445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c3dbd34-c1ec-4fb7-9254-71a0ba94d04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:01.825747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1020/2074] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:01 2022] DELETE /identity/v3/projects/acd0d32a89e44b1da177ee6c8a874fff => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:01.827378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f38e1-0e98-4163-94a0-d518c284bab3 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:01.827835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f38e1-0e98-4163-94a0-d518c284bab3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:01.829184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f38e1-0e98-4163-94a0-d518c284bab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:01.855420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-2a0f38e1-0e98-4163-94a0-d518c284bab3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:01.856731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2a0f38e1-0e98-4163-94a0-d518c284bab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:01.901807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:01.922873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1055/2075] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:01.932080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1e1a4-6f31-456c-9759-dc497716558d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:01.932371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1e1a4-6f31-456c-9759-dc497716558d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:01.932654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1e1a4-6f31-456c-9759-dc497716558d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:01.952249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-eac1e1a4-6f31-456c-9759-dc497716558d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:01.953434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-eac1e1a4-6f31-456c-9759-dc497716558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:01.962066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1021/2076] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:01.966325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f38e1-0e98-4163-94a0-d518c284bab3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:01.975990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f38e1-0e98-4163-94a0-d518c284bab3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:01.981307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:01.981925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:01.982210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:01.982485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:01.983226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:53:01.983531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:01.985130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:01.998975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1056/2077] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:53:02.001731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1e1a4-6f31-456c-9759-dc497716558d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:02.011116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1e1a4-6f31-456c-9759-dc497716558d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:02.016083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61d99-b323-4618-b1dc-5da494ff0e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:02.016700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61d99-b323-4618-b1dc-5da494ff0e85 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:02.016983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61d99-b323-4618-b1dc-5da494ff0e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:02.017289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61d99-b323-4618-b1dc-5da494ff0e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:02.017971 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b61d99-b323-4618-b1dc-5da494ff0e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:02.019927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b61d99-b323-4618-b1dc-5da494ff0e85 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:02.048341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1022/2078] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:53:02 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:53:02.052496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:02.065201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add6ce0-d69d-4922-b3d1-64e98338d93f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:02.138592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18be9aa-72a6-4058-b7d1-0dd72e0fef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:02.139255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18be9aa-72a6-4058-b7d1-0dd72e0fef7d admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:02.139570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18be9aa-72a6-4058-b7d1-0dd72e0fef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:02.139858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18be9aa-72a6-4058-b7d1-0dd72e0fef7d admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:02.140545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18be9aa-72a6-4058-b7d1-0dd72e0fef7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:02.142516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18be9aa-72a6-4058-b7d1-0dd72e0fef7d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:02.167901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1057/2079] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:53:02 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:53:02.171144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61d99-b323-4618-b1dc-5da494ff0e85 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:02.181701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61d99-b323-4618-b1dc-5da494ff0e85 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:02.186316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d92e-e72a-42cd-a2d0-7d075e54ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:02.186955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d92e-e72a-42cd-a2d0-7d075e54ff09 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:02.187257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d92e-e72a-42cd-a2d0-7d075e54ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:02.187536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d92e-e72a-42cd-a2d0-7d075e54ff09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:02.188238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2d92e-e72a-42cd-a2d0-7d075e54ff09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:02.189836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2d92e-e72a-42cd-a2d0-7d075e54ff09 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:02.200117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1023/2080] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:02.203960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18be9aa-72a6-4058-b7d1-0dd72e0fef7d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:02.215047 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18be9aa-72a6-4058-b7d1-0dd72e0fef7d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:02.219935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618e073-2f11-450d-beb4-5aabd6365f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:02.220572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618e073-2f11-450d-beb4-5aabd6365f46 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:02.220838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618e073-2f11-450d-beb4-5aabd6365f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:02.221117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618e073-2f11-450d-beb4-5aabd6365f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:02.221827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618e073-2f11-450d-beb4-5aabd6365f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:02.223532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618e073-2f11-450d-beb4-5aabd6365f46 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:02.234943 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1058/2081] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:02.238980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d92e-e72a-42cd-a2d0-7d075e54ff09 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:02.248867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d92e-e72a-42cd-a2d0-7d075e54ff09 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:02.253475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:02.254142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:02.254427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:02.254707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] PATH_INFO: `/v3/projects/683afbec3da846dca5198a1f1579152e/users/083dbcc58259466095bc2f37f7d2c283/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:02.269133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683afbec3da846dca5198a1f1579152e, user_id=083dbcc58259466095bc2f37f7d2c283, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:02.271800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:02.285262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1024/2082] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:02 2022] PUT /identity/v3/projects/683afbec3da846dca5198a1f1579152e/users/083dbcc58259466095bc2f37f7d2c283/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:02.290720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d722a-eecd-45b5-b5be-d4e3a256cfe8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:02.291041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d722a-eecd-45b5-b5be-d4e3a256cfe8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:02.291326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d722a-eecd-45b5-b5be-d4e3a256cfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:02.309749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-208d722a-eecd-45b5-b5be-d4e3a256cfe8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:02.310957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-208d722a-eecd-45b5-b5be-d4e3a256cfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:02.368978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1059/2083] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:02.378404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:02.380124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:02.412057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:02.437521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fa60f-5cbe-4c04-a559-9336fdca78e6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:02.441107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:02.441721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:02.442005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:02.442282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:02.451600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:02.453062 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:02.463315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1025/2084] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:53:03.351325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7337a-dd15-4b67-879e-5fe15a577a86 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:03.352681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7337a-dd15-4b67-879e-5fe15a577a86 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:03.352970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7337a-dd15-4b67-879e-5fe15a577a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:03.383751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-41e7337a-dd15-4b67-879e-5fe15a577a86 None None] MFA Rules not processed for user `083dbcc58259466095bc2f37f7d2c283`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:03.385007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-41e7337a-dd15-4b67-879e-5fe15a577a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:03.430966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:03.470779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1060/2085] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:03.478524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:03.480182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:03.542633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4592c9-ab48-4d54-9958-d0d68790a5a1 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:03.546522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a840bf-a762-44d5-a0e9-30a772209b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:03.547285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a840bf-a762-44d5-a0e9-30a772209b23 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:03.547668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a840bf-a762-44d5-a0e9-30a772209b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:03.548045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a840bf-a762-44d5-a0e9-30a772209b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:03.559042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a840bf-a762-44d5-a0e9-30a772209b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:03.560756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a840bf-a762-44d5-a0e9-30a772209b23 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:03.582637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1026/2086] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:05.671556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7337a-dd15-4b67-879e-5fe15a577a86 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:05.673141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-41e7337a-dd15-4b67-879e-5fe15a577a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:05.689867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7337a-dd15-4b67-879e-5fe15a577a86 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:05.697550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:05.698571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:05.698921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:05.699358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] PATH_INFO: `/v3/users/6daa9d3223764374bc5fc76387d07355` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:05.700661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6daa9d3223764374bc5fc76387d07355)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:05.703085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:05.769995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6daa9d3223764374bc5fc76387d07355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:05.779605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6daa9d3223764374bc5fc76387d07355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:05.789416 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6daa9d3223764374bc5fc76387d07355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:05.790099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6daa9d3223764374bc5fc76387d07355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:05.804744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6daa9d3223764374bc5fc76387d07355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:05.812394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1061/2087] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:05 2022] DELETE /identity/v3/users/6daa9d3223764374bc5fc76387d07355 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:05.817074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6ac3c-6d81-4da8-9e5a-d4facd63b3a9 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:05.817548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6ac3c-6d81-4da8-9e5a-d4facd63b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:05.818080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6ac3c-6d81-4da8-9e5a-d4facd63b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:05.845033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-74a6ac3c-6d81-4da8-9e5a-d4facd63b3a9 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:05.846713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-74a6ac3c-6d81-4da8-9e5a-d4facd63b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:05.923760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1027/2088] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:05.935753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:05.937267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:06.011663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c0f9e-220c-4d0e-aef5-707c644892f5 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:06.033535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:06.034171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4636a-62fc-4bc4-ab8a-87159f4102cb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:06.034469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4636a-62fc-4bc4-ab8a-87159f4102cb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:06.034748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4636a-62fc-4bc4-ab8a-87159f4102cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:06.035152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:06.035846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:06.036290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:06.056150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:06.058884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:06.061883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-93f4636a-62fc-4bc4-ab8a-87159f4102cb None None] MFA Rules not processed for user `083dbcc58259466095bc2f37f7d2c283`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:06.063500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-93f4636a-62fc-4bc4-ab8a-87159f4102cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:06.077242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1062/2089] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:06.164161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1028/2090] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:06.391007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:06.392492 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:06.422406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d1d25-be07-4cd1-90ae-d35e56ccab98 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:06.432370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:06.433221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:06.433696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:06.434080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] PATH_INFO: `/v3/projects/e78891a3061047f885af8f25b296a09f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:06.435514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78891a3061047f885af8f25b296a09f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:06.437911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:06.481707 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4636a-62fc-4bc4-ab8a-87159f4102cb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:06.483475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-93f4636a-62fc-4bc4-ab8a-87159f4102cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:06.497249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78891a3061047f885af8f25b296a09f', 'request_id': 'req-b0d6dd6e-647b-4758-ad1c-287295e4a94d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.497907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4636a-62fc-4bc4-ab8a-87159f4102cb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:06.499172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:06.506453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78891a3061047f885af8f25b296a09f', 'request_id': 'req-b0d6dd6e-647b-4758-ad1c-287295e4a94d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.514474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78891a3061047f885af8f25b296a09f', 'request_id': 'req-b0d6dd6e-647b-4758-ad1c-287295e4a94d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.520806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:06.527637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] The token cache is being invalidate because project e78891a3061047f885af8f25b296a09f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:06.527938 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.528605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-b0d6dd6e-647b-4758-ad1c-287295e4a94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.530346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1063/2091] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:06 2022] DELETE /identity/v3/projects/e78891a3061047f885af8f25b296a09f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:06.576737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:06.577591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:06.577879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:06.578180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] PATH_INFO: `/v3/users/4771347e11d849e195f64132902eb1c3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:06.579494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4771347e11d849e195f64132902eb1c3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:06.581632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:06.646759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4771347e11d849e195f64132902eb1c3'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.656058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4771347e11d849e195f64132902eb1c3'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.656829 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4771347e11d849e195f64132902eb1c3'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.671059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4771347e11d849e195f64132902eb1c3'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.671801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4771347e11d849e195f64132902eb1c3'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:06.690146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1029/2092] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:06 2022] DELETE /identity/v3/users/4771347e11d849e195f64132902eb1c3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:53:06.696281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407954b-485e-467c-9ab1-d2fda9ead6e4 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:06.697318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407954b-485e-467c-9ab1-d2fda9ead6e4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:06.697837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407954b-485e-467c-9ab1-d2fda9ead6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:06.720813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5407954b-485e-467c-9ab1-d2fda9ead6e4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:06.722229 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5407954b-485e-467c-9ab1-d2fda9ead6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:06.808967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1064/2093] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:53:06.818845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:06.820426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:06.920933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1486a-5d24-49db-8c69-ddc938e50d26 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:06.925863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8112c-5f4f-4939-ba49-164551ca221e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:06.926777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8112c-5f4f-4939-ba49-164551ca221e service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:06.927280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8112c-5f4f-4939-ba49-164551ca221e service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:06.927788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8112c-5f4f-4939-ba49-164551ca221e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:06.942659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8112c-5f4f-4939-ba49-164551ca221e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:06.945936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8112c-5f4f-4939-ba49-164551ca221e service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:06.962075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1030/2094] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:07.102961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407954b-485e-467c-9ab1-d2fda9ead6e4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:07.104769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5407954b-485e-467c-9ab1-d2fda9ead6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:07.125710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407954b-485e-467c-9ab1-d2fda9ead6e4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:07.144094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:07.144877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:07.145062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:07.145399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] PATH_INFO: `/v3/users/e1cc4e5238d047d791d63705e436274b` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:07.153989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1cc4e5238d047d791d63705e436274b)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:07.158965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:07.254595 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1cc4e5238d047d791d63705e436274b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.272907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1cc4e5238d047d791d63705e436274b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.289019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1cc4e5238d047d791d63705e436274b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.290700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1cc4e5238d047d791d63705e436274b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.316891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1cc4e5238d047d791d63705e436274b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.328531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1065/2095] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:07 2022] DELETE /identity/v3/users/e1cc4e5238d047d791d63705e436274b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:07.331091 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97920-9808-4b17-a714-9633e5a93565 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:07.331453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97920-9808-4b17-a714-9633e5a93565 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:07.332251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97920-9808-4b17-a714-9633e5a93565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:07.355514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-74c97920-9808-4b17-a714-9633e5a93565 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:07.356859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-74c97920-9808-4b17-a714-9633e5a93565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:07.407598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:07.429677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:07.431221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:07.434976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1031/2096] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:53:07.444620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c97920-9808-4b17-a714-9633e5a93565 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:07.446581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-74c97920-9808-4b17-a714-9633e5a93565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:07.451934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df2341-3b9f-43b7-9994-6462e16d04f7 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:07.465728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:07.466563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:07.466980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:07.467368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] PATH_INFO: `/v3/projects/94bca14a05374f3bbdbfa9ac35af19c3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:07.469770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bca14a05374f3bbdbfa9ac35af19c3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:07.471860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:07.518852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c97920-9808-4b17-a714-9633e5a93565 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:07.523396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664561-f022-47e5-bc5c-5974da0496c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:07.524751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664561-f022-47e5-bc5c-5974da0496c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:07.525124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664561-f022-47e5-bc5c-5974da0496c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:07.525508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664561-f022-47e5-bc5c-5974da0496c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:07.535663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e664561-f022-47e5-bc5c-5974da0496c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:07.537179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e664561-f022-47e5-bc5c-5974da0496c3 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:07.546055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:INSERT=2,keystone:DELETE=16,keystone:SELECT=82 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:07.548140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1032/2097] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:53:07.553090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bca14a05374f3bbdbfa9ac35af19c3', 'request_id': 'req-fc65919a-30df-4a4e-8c33-10ad785f1960'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.565336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bca14a05374f3bbdbfa9ac35af19c3', 'request_id': 'req-fc65919a-30df-4a4e-8c33-10ad785f1960'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.572773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bca14a05374f3bbdbfa9ac35af19c3', 'request_id': 'req-fc65919a-30df-4a4e-8c33-10ad785f1960'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.589461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] The token cache is being invalidate because project 94bca14a05374f3bbdbfa9ac35af19c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:07.589752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.590434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.594883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1066/2098] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:07 2022] DELETE /identity/v3/projects/94bca14a05374f3bbdbfa9ac35af19c3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:53:07.596732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664561-f022-47e5-bc5c-5974da0496c3 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:07.619223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664561-f022-47e5-bc5c-5974da0496c3 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:07.714319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:07.715132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:07.715426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:07.715776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] PATH_INFO: `/v3/users/c8196350cbc140c8b97df914d58c9319` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:07.717071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8196350cbc140c8b97df914d58c9319)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:07.719399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:07.774639 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8196350cbc140c8b97df914d58c9319'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.782316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8196350cbc140c8b97df914d58c9319'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.783096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8196350cbc140c8b97df914d58c9319'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.796984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8196350cbc140c8b97df914d58c9319'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.797273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8196350cbc140c8b97df914d58c9319'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:07.811591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1033/2099] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:07 2022] DELETE /identity/v3/users/c8196350cbc140c8b97df914d58c9319 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:07.860365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:07.862001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:07.878972 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65919a-30df-4a4e-8c33-10ad785f1960 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:07.956063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:07.956798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:07.957102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:07.957385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] PATH_INFO: `/v3/projects/dedd859766b8481ea4a712b3b8e98551` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:07.958694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dedd859766b8481ea4a712b3b8e98551)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:07.960681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:08.017214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dedd859766b8481ea4a712b3b8e98551', 'request_id': 'req-37df6283-4970-4b6b-bec3-eba5c6d04727'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.034810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dedd859766b8481ea4a712b3b8e98551', 'request_id': 'req-37df6283-4970-4b6b-bec3-eba5c6d04727'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.044874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dedd859766b8481ea4a712b3b8e98551', 'request_id': 'req-37df6283-4970-4b6b-bec3-eba5c6d04727'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.057907 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] The token cache is being invalidate because project dedd859766b8481ea4a712b3b8e98551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:08.058153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.058953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.061005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1067/2100] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:07 2022] DELETE /identity/v3/projects/dedd859766b8481ea4a712b3b8e98551 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:08.064682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:08.066140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:08.086880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:08.091389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eddbfe-ece7-4474-9cda-10bade1070e3 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:08.169859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:08.172281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:08.175633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:08.176541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:08.176975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:08.177436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] PATH_INFO: `/v3/users/20aac444d016464b956949955b9f3558` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:08.180705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20aac444d016464b956949955b9f3558)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:08.183774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:08.189508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df6283-4970-4b6b-bec3-eba5c6d04727 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:08.200998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:08.201673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:08.201956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:08.202232 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] PATH_INFO: `/v3/projects/d8c6ab55788b448ba746a78aaafbec28` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:08.203539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c6ab55788b448ba746a78aaafbec28)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:08.205999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:08.251728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20aac444d016464b956949955b9f3558'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.260256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20aac444d016464b956949955b9f3558'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.260973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20aac444d016464b956949955b9f3558'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.263604 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c6ab55788b448ba746a78aaafbec28', 'request_id': 'req-63d26c1c-b463-4b84-962a-6573568f437f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.273383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c6ab55788b448ba746a78aaafbec28', 'request_id': 'req-63d26c1c-b463-4b84-962a-6573568f437f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.276602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:08.277867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20aac444d016464b956949955b9f3558'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.279068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20aac444d016464b956949955b9f3558'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.282355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c6ab55788b448ba746a78aaafbec28', 'request_id': 'req-63d26c1c-b463-4b84-962a-6573568f437f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.308524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] The token cache is being invalidate because project d8c6ab55788b448ba746a78aaafbec28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:08.311877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.313109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1034/2101] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:08 2022] DELETE /identity/v3/users/20aac444d016464b956949955b9f3558 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:08.313568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.320171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:08.322759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:08.326805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1068/2102] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:08 2022] DELETE /identity/v3/projects/d8c6ab55788b448ba746a78aaafbec28 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:53:08.498724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d736dd-fa3f-4a1b-8765-13d3875cb2c4 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:08.504253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:08.506371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:08.506841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:08.507159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] PATH_INFO: `/v3/users/680f28b58bbc45cca35e0462e74d47d6` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:08.508661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=680f28b58bbc45cca35e0462e74d47d6)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:08.510909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:08.555494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:08.602673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680f28b58bbc45cca35e0462e74d47d6'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.617042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680f28b58bbc45cca35e0462e74d47d6'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.618396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680f28b58bbc45cca35e0462e74d47d6'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.642960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680f28b58bbc45cca35e0462e74d47d6'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.643741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680f28b58bbc45cca35e0462e74d47d6'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:08.667596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1035/2103] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:08 2022] DELETE /identity/v3/users/680f28b58bbc45cca35e0462e74d47d6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:09.531033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:09.533536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:09.650879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d26c1c-b463-4b84-962a-6573568f437f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:09.753921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:09.760545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:09.762962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:09.762962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] PATH_INFO: `/v3/projects/0a0eb36f7b6a4f0986b8285dcfe86379` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:09.764664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0eb36f7b6a4f0986b8285dcfe86379)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:09.785681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:09.865463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0eb36f7b6a4f0986b8285dcfe86379', 'request_id': 'req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:09.878403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0eb36f7b6a4f0986b8285dcfe86379', 'request_id': 'req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:09.887583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0eb36f7b6a4f0986b8285dcfe86379', 'request_id': 'req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:09.903566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:09.905275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:09.907624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] The token cache is being invalidate because project 0a0eb36f7b6a4f0986b8285dcfe86379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:09.907986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:09.908679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-6e828100-bd5c-4ab6-b8ad-b7c4b04b99a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:09.910723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1069/2104] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:09 2022] DELETE /identity/v3/projects/0a0eb36f7b6a4f0986b8285dcfe86379 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:09.919586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae58b-b199-405d-9dfa-2b9f8645993f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:09.920404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae58b-b199-405d-9dfa-2b9f8645993f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:09.921070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae58b-b199-405d-9dfa-2b9f8645993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:09.934677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829e6d1-0262-42e7-8414-efe2f999d7bc admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:09.971084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-cf3ae58b-b199-405d-9dfa-2b9f8645993f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:09.973796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cf3ae58b-b199-405d-9dfa-2b9f8645993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:10.017409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:10.050088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.051585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.051973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.052356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] PATH_INFO: `/v3/projects/1bb6e11e36674d42998af37807c84f4c` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.053688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb6e11e36674d42998af37807c84f4c)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.057202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.126563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1070/2105] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:10.127285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb6e11e36674d42998af37807c84f4c', 'request_id': 'req-598b7860-18b5-4d97-95c8-64b7346b20a7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:10.128086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfb0ee-3d07-45d7-a76f-512eb47a3d5d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.128376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfb0ee-3d07-45d7-a76f-512eb47a3d5d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.128797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfb0ee-3d07-45d7-a76f-512eb47a3d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.134657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb6e11e36674d42998af37807c84f4c', 'request_id': 'req-598b7860-18b5-4d97-95c8-64b7346b20a7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:10.144735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb6e11e36674d42998af37807c84f4c', 'request_id': 'req-598b7860-18b5-4d97-95c8-64b7346b20a7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:10.150826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4fcfb0ee-3d07-45d7-a76f-512eb47a3d5d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:10.152281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4fcfb0ee-3d07-45d7-a76f-512eb47a3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:10.162296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] The token cache is being invalidate because project 1bb6e11e36674d42998af37807c84f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:10.162720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:10.163576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-598b7860-18b5-4d97-95c8-64b7346b20a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:10.166330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1036/2106] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:09 2022] DELETE /identity/v3/projects/1bb6e11e36674d42998af37807c84f4c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:53:10.172399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f0ca-9add-4d34-a271-1376b0f847d4 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.172686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f0ca-9add-4d34-a271-1376b0f847d4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.172969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f0ca-9add-4d34-a271-1376b0f847d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.194655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-64a0f0ca-9add-4d34-a271-1376b0f847d4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:10.196412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-64a0f0ca-9add-4d34-a271-1376b0f847d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:10.225148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1071/2107] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:10.232303 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfb0ee-3d07-45d7-a76f-512eb47a3d5d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.233659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:10.245274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfb0ee-3d07-45d7-a76f-512eb47a3d5d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.251752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.253170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.253792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.254075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.254787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:53:10.255126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.256853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.271293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1072/2108] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:53:10.275712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.279085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1037/2109] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:10.286321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ce0d9-3704-405c-bd66-433ce3d71598 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.286698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ce0d9-3704-405c-bd66-433ce3d71598 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.287333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ce0d9-3704-405c-bd66-433ce3d71598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.293606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5907b3-7fdc-4977-abb6-4ff68c430f59 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.299275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615edca5-ce0a-4993-b43d-f762d0ba1100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.300010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615edca5-ce0a-4993-b43d-f762d0ba1100 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.300391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615edca5-ce0a-4993-b43d-f762d0ba1100 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.300825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615edca5-ce0a-4993-b43d-f762d0ba1100 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.301592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615edca5-ce0a-4993-b43d-f762d0ba1100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.303641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615edca5-ce0a-4993-b43d-f762d0ba1100 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.322785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-876ce0d9-3704-405c-bd66-433ce3d71598 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:10.324288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-876ce0d9-3704-405c-bd66-433ce3d71598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:10.335608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1038/2110] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:10.340216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ce0d9-3704-405c-bd66-433ce3d71598 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.347284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1073/2111] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:53:10 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:53:10.350242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ce0d9-3704-405c-bd66-433ce3d71598 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.351120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615edca5-ce0a-4993-b43d-f762d0ba1100 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.428603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.429754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.430060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.430315 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.431121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:53:10.431479 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.433387 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.448838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1039/2112] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:53:10.453443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.468262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8e51-2c5e-48dc-9219-72664e486b74 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.470399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615edca5-ce0a-4993-b43d-f762d0ba1100 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.475990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95469f42-00ac-4836-9d48-42fa3a3efdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.477491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469f42-00ac-4836-9d48-42fa3a3efdce admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.477923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469f42-00ac-4836-9d48-42fa3a3efdce admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.478627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469f42-00ac-4836-9d48-42fa3a3efdce admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.479604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469f42-00ac-4836-9d48-42fa3a3efdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.481802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469f42-00ac-4836-9d48-42fa3a3efdce admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.485199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392a506-6752-45dd-b079-39a831f00f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.486423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392a506-6752-45dd-b079-39a831f00f01 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.487334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392a506-6752-45dd-b079-39a831f00f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.487822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392a506-6752-45dd-b079-39a831f00f01 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.489182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392a506-6752-45dd-b079-39a831f00f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.494750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392a506-6752-45dd-b079-39a831f00f01 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.527351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1040/2113] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:53:10 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:53:10.531198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95469f42-00ac-4836-9d48-42fa3a3efdce admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.551892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1074/2114] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:53:10 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:53:10.556441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392a506-6752-45dd-b079-39a831f00f01 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.569505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392a506-6752-45dd-b079-39a831f00f01 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.593694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:10.660348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5313763-dadc-4548-b629-89dcd5565b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.661464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5313763-dadc-4548-b629-89dcd5565b00 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.661955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5313763-dadc-4548-b629-89dcd5565b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.662477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5313763-dadc-4548-b629-89dcd5565b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.663576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5313763-dadc-4548-b629-89dcd5565b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.665985 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5313763-dadc-4548-b629-89dcd5565b00 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.680944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1075/2115] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:53:10.681425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95469f42-00ac-4836-9d48-42fa3a3efdce admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.684710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5313763-dadc-4548-b629-89dcd5565b00 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.687584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b03f39-c4f2-4ac7-9953-cdcd79f84019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.688225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b03f39-c4f2-4ac7-9953-cdcd79f84019 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.688505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b03f39-c4f2-4ac7-9953-cdcd79f84019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.688779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b03f39-c4f2-4ac7-9953-cdcd79f84019 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.689465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b03f39-c4f2-4ac7-9953-cdcd79f84019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.691430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b03f39-c4f2-4ac7-9953-cdcd79f84019 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.703790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5313763-dadc-4548-b629-89dcd5565b00 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.712018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f16e7-e3b3-4de7-ba67-ba24a66b5a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.713826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f16e7-e3b3-4de7-ba67-ba24a66b5a69 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.715074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f16e7-e3b3-4de7-ba67-ba24a66b5a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.715848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f16e7-e3b3-4de7-ba67-ba24a66b5a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.717069 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f16e7-e3b3-4de7-ba67-ba24a66b5a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.719103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f16e7-e3b3-4de7-ba67-ba24a66b5a69 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.739757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1076/2116] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:10.740979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f16e7-e3b3-4de7-ba67-ba24a66b5a69 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.760899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1041/2117] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:53:10 2022] POST /identity/v3/users => generated 284 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:53:10.768572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b03f39-c4f2-4ac7-9953-cdcd79f84019 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.776736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f16e7-e3b3-4de7-ba67-ba24a66b5a69 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.791278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b03f39-c4f2-4ac7-9953-cdcd79f84019 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.797755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568c10a-1cea-4166-badf-21d58724f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.800027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c10a-1cea-4166-badf-21d58724f101 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.800027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c10a-1cea-4166-badf-21d58724f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.800027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c10a-1cea-4166-badf-21d58724f101 admin admin] PATH_INFO: `/v3/projects/931eb2d5542b472d9eda46fee7db7420/users/f0d79a817c284417b300ecaafee1f2c7/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.804044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ee859-6f2c-4f7e-8665-010b93143c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.804694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee859-6f2c-4f7e-8665-010b93143c9d admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.805023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee859-6f2c-4f7e-8665-010b93143c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.805299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee859-6f2c-4f7e-8665-010b93143c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.806006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ee859-6f2c-4f7e-8665-010b93143c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.807636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ee859-6f2c-4f7e-8665-010b93143c9d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.830888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1042/2118] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:10.834412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ee859-6f2c-4f7e-8665-010b93143c9d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.835512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568c10a-1cea-4166-badf-21d58724f101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=931eb2d5542b472d9eda46fee7db7420, user_id=f0d79a817c284417b300ecaafee1f2c7, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.839201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568c10a-1cea-4166-badf-21d58724f101 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.862753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ee859-6f2c-4f7e-8665-010b93143c9d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.877535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:10.880404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1077/2119] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:10 2022] PUT /identity/v3/projects/931eb2d5542b472d9eda46fee7db7420/users/f0d79a817c284417b300ecaafee1f2c7/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:10.882237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb5ee-480d-425a-8266-5c6d6dd52147 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.883875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb5ee-480d-425a-8266-5c6d6dd52147 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.884171 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb5ee-480d-425a-8266-5c6d6dd52147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.938082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c6246-66d0-485f-bef7-aa0313b11a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.939281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c6246-66d0-485f-bef7-aa0313b11a67 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.939567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c6246-66d0-485f-bef7-aa0313b11a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.939847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c6246-66d0-485f-bef7-aa0313b11a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.940558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c6246-66d0-485f-bef7-aa0313b11a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:10.942492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c6246-66d0-485f-bef7-aa0313b11a67 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:10.957108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1043/2120] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:10.958207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c6246-66d0-485f-bef7-aa0313b11a67 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:10.973048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c6246-66d0-485f-bef7-aa0313b11a67 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:10.978084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d2363-ccec-45f4-a463-ada01f613c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:10.979477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d2363-ccec-45f4-a463-ada01f613c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:10.979477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d2363-ccec-45f4-a463-ada01f613c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:10.979477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d2363-ccec-45f4-a463-ada01f613c73 admin admin] PATH_INFO: `/v3/projects/f500984c7c7e46609b077d3117b1062c/users/b314cef999d141fba07d1cc1ab77297f/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:10.983777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-eb2cb5ee-480d-425a-8266-5c6d6dd52147 None None] MFA Rules not processed for user `f0d79a817c284417b300ecaafee1f2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:10.987698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-eb2cb5ee-480d-425a-8266-5c6d6dd52147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:10.998721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d2363-ccec-45f4-a463-ada01f613c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f500984c7c7e46609b077d3117b1062c, user_id=b314cef999d141fba07d1cc1ab77297f, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:11.001180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d2363-ccec-45f4-a463-ada01f613c73 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:11.047964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1044/2121] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:10 2022] PUT /identity/v3/projects/f500984c7c7e46609b077d3117b1062c/users/b314cef999d141fba07d1cc1ab77297f/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:11.051817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432be7-df7c-4fce-b925-f3b99da7ab98 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.052301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432be7-df7c-4fce-b925-f3b99da7ab98 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.052715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432be7-df7c-4fce-b925-f3b99da7ab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.101875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-85432be7-df7c-4fce-b925-f3b99da7ab98 None None] MFA Rules not processed for user `b314cef999d141fba07d1cc1ab77297f`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:11.104083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-85432be7-df7c-4fce-b925-f3b99da7ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:11.123504 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1078/2122] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:11.127916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cb5ee-480d-425a-8266-5c6d6dd52147 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:11.147108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cb5ee-480d-425a-8266-5c6d6dd52147 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:11.198990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1045/2123] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:53:11.218319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85432be7-df7c-4fce-b925-f3b99da7ab98 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:11.220189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-85432be7-df7c-4fce-b925-f3b99da7ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:11.222910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c277410-e318-4051-a76a-1c44c9679799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:11.223567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c277410-e318-4051-a76a-1c44c9679799 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.223846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c277410-e318-4051-a76a-1c44c9679799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.224117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c277410-e318-4051-a76a-1c44c9679799 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.224794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c277410-e318-4051-a76a-1c44c9679799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:11.228017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c277410-e318-4051-a76a-1c44c9679799 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:11.249605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:11.289015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1079/2124] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:53:11 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:53:11.291346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c277410-e318-4051-a76a-1c44c9679799 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:11.350223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85432be7-df7c-4fce-b925-f3b99da7ab98 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:11.375392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:11.445507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077c1a6-897d-420b-a424-b2a6d24c206e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde6248cf0794fab88a093097b597c9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:11.446517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c1a6-897d-420b-a424-b2a6d24c206e service glance] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.447030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c1a6-897d-420b-a424-b2a6d24c206e service glance] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.447505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077c1a6-897d-420b-a424-b2a6d24c206e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.447716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c277410-e318-4051-a76a-1c44c9679799 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:11.461451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122d1b7-851a-4bdc-91a0-2d09d53f98cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:11.462020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122d1b7-851a-4bdc-91a0-2d09d53f98cc admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.462729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122d1b7-851a-4bdc-91a0-2d09d53f98cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.463088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122d1b7-851a-4bdc-91a0-2d09d53f98cc admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.463784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122d1b7-851a-4bdc-91a0-2d09d53f98cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:11.465820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122d1b7-851a-4bdc-91a0-2d09d53f98cc admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:11.500250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1080/2125] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:53:11 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:53:11.508930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122d1b7-851a-4bdc-91a0-2d09d53f98cc admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:11.531814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122d1b7-851a-4bdc-91a0-2d09d53f98cc admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:11.552793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b604-42ab-4e22-b2f4-9edb11737f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:11.555889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b604-42ab-4e22-b2f4-9edb11737f7f admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.556170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b604-42ab-4e22-b2f4-9edb11737f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.556464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b604-42ab-4e22-b2f4-9edb11737f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.557223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0b604-42ab-4e22-b2f4-9edb11737f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:11.561190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0b604-42ab-4e22-b2f4-9edb11737f7f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:11.564404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077c1a6-897d-420b-a424-b2a6d24c206e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:11.567156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077c1a6-897d-420b-a424-b2a6d24c206e service glance] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:11.594042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1081/2126] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:11.596555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b604-42ab-4e22-b2f4-9edb11737f7f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:11.602701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1046/2127] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:53:11.627104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b604-42ab-4e22-b2f4-9edb11737f7f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:11.639398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa230ce-ab41-43f6-a890-bc0923be77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:11.640270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa230ce-ab41-43f6-a890-bc0923be77a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.640567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa230ce-ab41-43f6-a890-bc0923be77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.641092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa230ce-ab41-43f6-a890-bc0923be77a6 admin admin] PATH_INFO: `/v3/projects/2bbdd9775514494bba44d55230d0c764/users/bbd78d4665b34214b549d304777c9c4f/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.663417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa230ce-ab41-43f6-a890-bc0923be77a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbdd9775514494bba44d55230d0c764, user_id=bbd78d4665b34214b549d304777c9c4f, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:11.666586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa230ce-ab41-43f6-a890-bc0923be77a6 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:11.683967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1082/2128] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:11 2022] PUT /identity/v3/projects/2bbdd9775514494bba44d55230d0c764/users/bbd78d4665b34214b549d304777c9c4f/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:11.687947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077c1a6-897d-420b-a424-b2a6d24c206e service glance] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:11.707940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077c1a6-897d-420b-a424-b2a6d24c206e service glance] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:11.793285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482e7a3-5922-471c-bb15-36c7b6f43023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:11.793960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e7a3-5922-471c-bb15-36c7b6f43023 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.794252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e7a3-5922-471c-bb15-36c7b6f43023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.795214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e7a3-5922-471c-bb15-36c7b6f43023 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.795990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482e7a3-5922-471c-bb15-36c7b6f43023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:11.798344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482e7a3-5922-471c-bb15-36c7b6f43023 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:11.809965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1047/2129] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:11.813918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa230ce-ab41-43f6-a890-bc0923be77a6 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:11.828099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa230ce-ab41-43f6-a890-bc0923be77a6 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:11.838160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:11.839667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.840131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.840423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] PATH_INFO: `/v3/projects/2bbdd9775514494bba44d55230d0c764/users/bbd78d4665b34214b549d304777c9c4f/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.842521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbdd9775514494bba44d55230d0c764, user_id=bbd78d4665b34214b549d304777c9c4f, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:11.845889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:11.860182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1083/2130] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:11 2022] PUT /identity/v3/projects/2bbdd9775514494bba44d55230d0c764/users/bbd78d4665b34214b549d304777c9c4f/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:11.872931 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dbecf-0bf6-42e8-9943-e5d09069afee None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:11.873318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dbecf-0bf6-42e8-9943-e5d09069afee None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:11.873691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dbecf-0bf6-42e8-9943-e5d09069afee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:11.912234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-028dbecf-0bf6-42e8-9943-e5d09069afee None None] MFA Rules not processed for user `bbd78d4665b34214b549d304777c9c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:11.913963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-028dbecf-0bf6-42e8-9943-e5d09069afee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:12.010290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:12.050626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1048/2131] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:53:12.060866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:12.063509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:12.213922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f0e84-fa4f-419a-9e1b-a080038bda9e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:12.222148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301871-f460-43d3-ad5a-c21e47e2dbd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:12.222623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301871-f460-43d3-ad5a-c21e47e2dbd4 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:12.224518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301871-f460-43d3-ad5a-c21e47e2dbd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:12.225021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301871-f460-43d3-ad5a-c21e47e2dbd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:12.374959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:12.403669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301871-f460-43d3-ad5a-c21e47e2dbd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:12.405685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301871-f460-43d3-ad5a-c21e47e2dbd4 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:12.417812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1084/2132] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:16.934044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dbecf-0bf6-42e8-9943-e5d09069afee None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:16.935596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-028dbecf-0bf6-42e8-9943-e5d09069afee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:16.948058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dbecf-0bf6-42e8-9943-e5d09069afee None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:16.951618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7283d2-207c-44af-a1fa-9f480ee3468c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:16.952235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7283d2-207c-44af-a1fa-9f480ee3468c service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:16.952517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7283d2-207c-44af-a1fa-9f480ee3468c service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:16.952792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7283d2-207c-44af-a1fa-9f480ee3468c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:16.962368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7283d2-207c-44af-a1fa-9f480ee3468c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:16.963825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7283d2-207c-44af-a1fa-9f480ee3468c service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:16.973346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1049/2133] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:21.914224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301871-f460-43d3-ad5a-c21e47e2dbd4 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:21.999469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301871-f460-43d3-ad5a-c21e47e2dbd4 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:22.004570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:22.005458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:22.005884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:22.006241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] PATH_INFO: `/v3/users/f0d79a817c284417b300ecaafee1f2c7` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:22.008832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d79a817c284417b300ecaafee1f2c7)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:22.024950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:22.081464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d79a817c284417b300ecaafee1f2c7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.090035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d79a817c284417b300ecaafee1f2c7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.097430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d79a817c284417b300ecaafee1f2c7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.098089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d79a817c284417b300ecaafee1f2c7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.110974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d79a817c284417b300ecaafee1f2c7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.117337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1085/2134] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:21 2022] DELETE /identity/v3/users/f0d79a817c284417b300ecaafee1f2c7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:22.121770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400cd3-9b23-494c-8c8c-a13ee32eb336 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:22.122269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400cd3-9b23-494c-8c8c-a13ee32eb336 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:22.122362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400cd3-9b23-494c-8c8c-a13ee32eb336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:22.143207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d8400cd3-9b23-494c-8c8c-a13ee32eb336 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:22.147390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d8400cd3-9b23-494c-8c8c-a13ee32eb336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:22.212190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1050/2135] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:53:22.221869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:22.223326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:22.285421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376ffd1-82e0-4407-93ca-9931018dd0f4 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:22.289728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358db984-29aa-4c29-818a-72bb6da526cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:22.290348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358db984-29aa-4c29-818a-72bb6da526cd service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:22.290631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358db984-29aa-4c29-818a-72bb6da526cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:22.290904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358db984-29aa-4c29-818a-72bb6da526cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:22.303734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358db984-29aa-4c29-818a-72bb6da526cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:22.305734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358db984-29aa-4c29-818a-72bb6da526cd service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:22.316708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1086/2136] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:22.587987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400cd3-9b23-494c-8c8c-a13ee32eb336 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:22.589505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d8400cd3-9b23-494c-8c8c-a13ee32eb336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:22.603950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400cd3-9b23-494c-8c8c-a13ee32eb336 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:22.608868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:22.609519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:22.609802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:22.610080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] PATH_INFO: `/v3/projects/931eb2d5542b472d9eda46fee7db7420` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:22.611292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] RBAC: Authorizing `identity:delete_project(project_id=931eb2d5542b472d9eda46fee7db7420)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:22.613202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:22.664750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931eb2d5542b472d9eda46fee7db7420', 'request_id': 'req-42a33302-6fd1-4b12-80af-7de9dbbd174d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.670965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931eb2d5542b472d9eda46fee7db7420', 'request_id': 'req-42a33302-6fd1-4b12-80af-7de9dbbd174d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.677962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931eb2d5542b472d9eda46fee7db7420', 'request_id': 'req-42a33302-6fd1-4b12-80af-7de9dbbd174d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.688824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] The token cache is being invalidate because project 931eb2d5542b472d9eda46fee7db7420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:22.689119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.689761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.691363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1051/2137] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:22 2022] DELETE /identity/v3/projects/931eb2d5542b472d9eda46fee7db7420 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:22.695374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358db984-29aa-4c29-818a-72bb6da526cd service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:22.704967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358db984-29aa-4c29-818a-72bb6da526cd service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:22.713427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:22.763569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:22.764215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:22.764497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:22.764776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] PATH_INFO: `/v3/users/bbd78d4665b34214b549d304777c9c4f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:22.765943 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd78d4665b34214b549d304777c9c4f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:22.767944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:22.813969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd78d4665b34214b549d304777c9c4f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.822006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd78d4665b34214b549d304777c9c4f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.829419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd78d4665b34214b549d304777c9c4f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.830130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd78d4665b34214b549d304777c9c4f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.847211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c3f2dea8-ffca-454d-8615-f95bfdb01810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd78d4665b34214b549d304777c9c4f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:22.854268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1087/2138] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:22 2022] DELETE /identity/v3/users/bbd78d4665b34214b549d304777c9c4f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:23.206149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:23.207744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:23.220982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a33302-6fd1-4b12-80af-7de9dbbd174d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:23.283671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:23.284328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.284613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.284891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] PATH_INFO: `/v3/projects/2bbdd9775514494bba44d55230d0c764` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.286101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbdd9775514494bba44d55230d0c764)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:23.288107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:23.291122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:23.338635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbdd9775514494bba44d55230d0c764', 'request_id': 'req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:23.345212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbdd9775514494bba44d55230d0c764', 'request_id': 'req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:23.352607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbdd9775514494bba44d55230d0c764', 'request_id': 'req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:23.363586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] The token cache is being invalidate because project 2bbdd9775514494bba44d55230d0c764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:23.363905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:23.364560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8136bb84-1c3a-4104-b3c7-89b3e5d1ee39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:23.366092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1052/2139] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:23 2022] DELETE /identity/v3/projects/2bbdd9775514494bba44d55230d0c764 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:23.372021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb099-0b31-47a9-bb82-eb0d45e36b71 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.372487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb099-0b31-47a9-bb82-eb0d45e36b71 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.372593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb099-0b31-47a9-bb82-eb0d45e36b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.393246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-59deb099-0b31-47a9-bb82-eb0d45e36b71 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:23.394410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-59deb099-0b31-47a9-bb82-eb0d45e36b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:23.456713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1088/2140] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:23.465684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c92ba-bdf0-4d53-9d8e-a2cffe26e4f3 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.466171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c92ba-bdf0-4d53-9d8e-a2cffe26e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.466546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c92ba-bdf0-4d53-9d8e-a2cffe26e4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.488951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0d3c92ba-bdf0-4d53-9d8e-a2cffe26e4f3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:23.490319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0d3c92ba-bdf0-4d53-9d8e-a2cffe26e4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:23.506458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1053/2141] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:23.511392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb099-0b31-47a9-bb82-eb0d45e36b71 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:23.523241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb099-0b31-47a9-bb82-eb0d45e36b71 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:23.529220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:23.529916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.530270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.530619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.531515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:53:23.531892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:23.533577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:23.555765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1089/2142] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:53:23.556869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c92ba-bdf0-4d53-9d8e-a2cffe26e4f3 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:23.566396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c92ba-bdf0-4d53-9d8e-a2cffe26e4f3 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:23.574470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd80b2-8a3b-4860-be78-2b6680aa7391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:23.574470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd80b2-8a3b-4860-be78-2b6680aa7391 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.574816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd80b2-8a3b-4860-be78-2b6680aa7391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.574896 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd80b2-8a3b-4860-be78-2b6680aa7391 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.575625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd80b2-8a3b-4860-be78-2b6680aa7391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:23.578154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd80b2-8a3b-4860-be78-2b6680aa7391 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:23.614879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1054/2143] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:53:23 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:53:23.619977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:23.633394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6a0a4-439b-471d-a304-e04c5f79b549 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:23.651915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:23.694467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d22b-6aef-4c92-a245-f5e6d6b6af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:23.695131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d22b-6aef-4c92-a245-f5e6d6b6af96 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.696021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d22b-6aef-4c92-a245-f5e6d6b6af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.696739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d22b-6aef-4c92-a245-f5e6d6b6af96 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.697559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d22b-6aef-4c92-a245-f5e6d6b6af96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:23.699774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d22b-6aef-4c92-a245-f5e6d6b6af96 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:23.725201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1090/2144] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:53:23 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:53:23.726704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd80b2-8a3b-4860-be78-2b6680aa7391 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:23.737629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd80b2-8a3b-4860-be78-2b6680aa7391 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:23.743043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eddfa-775d-44c2-a07a-701fcd3ecaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:23.743658 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eddfa-775d-44c2-a07a-701fcd3ecaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.744049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eddfa-775d-44c2-a07a-701fcd3ecaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.744451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eddfa-775d-44c2-a07a-701fcd3ecaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.745007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eddfa-775d-44c2-a07a-701fcd3ecaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:23.746606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eddfa-775d-44c2-a07a-701fcd3ecaf2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:23.756825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1055/2145] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:23.761620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d22b-6aef-4c92-a245-f5e6d6b6af96 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:23.772199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d22b-6aef-4c92-a245-f5e6d6b6af96 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:23.776974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2f53d-f1fa-483a-93e6-5430cebc945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:23.777591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f53d-f1fa-483a-93e6-5430cebc945e admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.777870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f53d-f1fa-483a-93e6-5430cebc945e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.778141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f53d-f1fa-483a-93e6-5430cebc945e admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.778865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2f53d-f1fa-483a-93e6-5430cebc945e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:23.780478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2f53d-f1fa-483a-93e6-5430cebc945e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:23.791158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1091/2146] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:23.795377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eddfa-775d-44c2-a07a-701fcd3ecaf2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:23.806954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eddfa-775d-44c2-a07a-701fcd3ecaf2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:23.811648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:23.812313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.812592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.812865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] PATH_INFO: `/v3/projects/2b165392bdcc408f97099bd7bbcb4483/users/d1bb723c4b3246029e0f0c6d791d6332/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.828114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b165392bdcc408f97099bd7bbcb4483, user_id=d1bb723c4b3246029e0f0c6d791d6332, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:23.830774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:23.849584 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1056/2147] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:23 2022] PUT /identity/v3/projects/2b165392bdcc408f97099bd7bbcb4483/users/d1bb723c4b3246029e0f0c6d791d6332/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:23.858098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c3ec-642b-4663-8389-a93b3302adf9 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:23.858386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c3ec-642b-4663-8389-a93b3302adf9 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:23.858662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c3ec-642b-4663-8389-a93b3302adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:23.888897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4ff4c3ec-642b-4663-8389-a93b3302adf9 None None] MFA Rules not processed for user `d1bb723c4b3246029e0f0c6d791d6332`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:23.890135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4ff4c3ec-642b-4663-8389-a93b3302adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:23.954789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1092/2148] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:23.966441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:23.968210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:24.029628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3be1ca-8b6c-4074-8a3f-174fa444ff87 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:24.033599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:24.034231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:24.034521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:24.034796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:24.051763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:24.053304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:24.063208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1057/2149] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:33.951881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:34.059010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:43.288423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bac6e-a023-4210-917a-5fca140a3789 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:43.288983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bac6e-a023-4210-917a-5fca140a3789 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:43.288983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bac6e-a023-4210-917a-5fca140a3789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:43.307821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-241bac6e-a023-4210-917a-5fca140a3789 None None] MFA Rules not processed for user `083dbcc58259466095bc2f37f7d2c283`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:43.309549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-241bac6e-a023-4210-917a-5fca140a3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:43.363981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1093/2150] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:45.678406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:45.679988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:45.747511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ed57b-9348-4e6b-854f-3d35850f2228 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:45.751975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:45.752606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:45.752885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:45.753157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] PATH_INFO: `/v3/users/760d5fbf0ff648a1805f0351168429e9` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:45.754304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] RBAC: Authorizing `identity:delete_user(user_id=760d5fbf0ff648a1805f0351168429e9)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:45.756245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:45.801532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760d5fbf0ff648a1805f0351168429e9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:45.808504 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760d5fbf0ff648a1805f0351168429e9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:45.809712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760d5fbf0ff648a1805f0351168429e9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:45.824929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760d5fbf0ff648a1805f0351168429e9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:45.825730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-65a53bac-9efc-4f82-9d0c-ca8e7e08493b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760d5fbf0ff648a1805f0351168429e9'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:45.838211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1058/2151] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:53:45 2022] DELETE /identity/v3/users/760d5fbf0ff648a1805f0351168429e9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:46.011425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bac6e-a023-4210-917a-5fca140a3789 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.022669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bac6e-a023-4210-917a-5fca140a3789 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.086364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.087043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.087329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.087607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] PATH_INFO: `/v3/projects/782d8228cf8d4caaa5b3820a1868df53` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.088812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] RBAC: Authorizing `identity:delete_project(project_id=782d8228cf8d4caaa5b3820a1868df53)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.091265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.146356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782d8228cf8d4caaa5b3820a1868df53', 'request_id': 'req-c6c511e6-a8dc-45cd-b253-8bcf7516999a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:46.154561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782d8228cf8d4caaa5b3820a1868df53', 'request_id': 'req-c6c511e6-a8dc-45cd-b253-8bcf7516999a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:46.161827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782d8228cf8d4caaa5b3820a1868df53', 'request_id': 'req-c6c511e6-a8dc-45cd-b253-8bcf7516999a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:46.174988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] The token cache is being invalidate because project 782d8228cf8d4caaa5b3820a1868df53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:53:46.175272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:46.175948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6c511e6-a8dc-45cd-b253-8bcf7516999a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:53:46.177755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1094/2152] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:53:46 2022] DELETE /identity/v3/projects/782d8228cf8d4caaa5b3820a1868df53 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:46.182397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6393-85fc-4646-8842-64e27b542006 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.182690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6393-85fc-4646-8842-64e27b542006 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.183004 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6393-85fc-4646-8842-64e27b542006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.202154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-2dea6393-85fc-4646-8842-64e27b542006 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:46.203324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2dea6393-85fc-4646-8842-64e27b542006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:46.265694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1059/2153] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:46.273485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24ce9-1ec3-4c27-acd7-18cf7fdbcd0a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.273785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24ce9-1ec3-4c27-acd7-18cf7fdbcd0a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.274060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24ce9-1ec3-4c27-acd7-18cf7fdbcd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.294806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8eb24ce9-1ec3-4c27-acd7-18cf7fdbcd0a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:46.296050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8eb24ce9-1ec3-4c27-acd7-18cf7fdbcd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:46.304074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1095/2154] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:46.308264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6393-85fc-4646-8842-64e27b542006 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.318011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6393-85fc-4646-8842-64e27b542006 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.322836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.323482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.323770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.324049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.324808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:53:46.325120 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.326722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.338360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1060/2155] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:53:46.342998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24ce9-1ec3-4c27-acd7-18cf7fdbcd0a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.352536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24ce9-1ec3-4c27-acd7-18cf7fdbcd0a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.357925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9a4e2-23f5-448e-b3e3-e67a917b5fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.358551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9a4e2-23f5-448e-b3e3-e67a917b5fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.358835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9a4e2-23f5-448e-b3e3-e67a917b5fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.359146 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9a4e2-23f5-448e-b3e3-e67a917b5fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.359822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9a4e2-23f5-448e-b3e3-e67a917b5fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.361882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9a4e2-23f5-448e-b3e3-e67a917b5fc3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.393668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1096/2156] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:53:46 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:53:46.397753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.410327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f01a2c-0350-4057-9cc5-93b1b9657e83 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.414591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:46.481188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5e7f8-2989-45ba-a70d-999e039217be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.481775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5e7f8-2989-45ba-a70d-999e039217be admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.482055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5e7f8-2989-45ba-a70d-999e039217be admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.482483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5e7f8-2989-45ba-a70d-999e039217be admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.483193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5e7f8-2989-45ba-a70d-999e039217be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.485125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5e7f8-2989-45ba-a70d-999e039217be admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.506826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1061/2157] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:53:46 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:53:46.511170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9a4e2-23f5-448e-b3e3-e67a917b5fc3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.522457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9a4e2-23f5-448e-b3e3-e67a917b5fc3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.527088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6f339-28ca-4ae5-9713-1b6f3e399138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.528363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6f339-28ca-4ae5-9713-1b6f3e399138 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.528654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6f339-28ca-4ae5-9713-1b6f3e399138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.528928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6f339-28ca-4ae5-9713-1b6f3e399138 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.529629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6f339-28ca-4ae5-9713-1b6f3e399138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.531253 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6f339-28ca-4ae5-9713-1b6f3e399138 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.532483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:46.542480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1097/2158] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:46.546128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5e7f8-2989-45ba-a70d-999e039217be admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.556134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5e7f8-2989-45ba-a70d-999e039217be admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.560664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fdb11-f9a1-4c61-a4e3-e68867f957d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.561274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fdb11-f9a1-4c61-a4e3-e68867f957d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.561581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fdb11-f9a1-4c61-a4e3-e68867f957d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.561857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fdb11-f9a1-4c61-a4e3-e68867f957d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.562552 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fdb11-f9a1-4c61-a4e3-e68867f957d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.564163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fdb11-f9a1-4c61-a4e3-e68867f957d9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.575275 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1062/2159] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:46.579036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6f339-28ca-4ae5-9713-1b6f3e399138 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.589062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6f339-28ca-4ae5-9713-1b6f3e399138 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.594376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84222b-d8e3-44ee-a39b-754facf4b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.595065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84222b-d8e3-44ee-a39b-754facf4b6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.595351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84222b-d8e3-44ee-a39b-754facf4b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.595630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84222b-d8e3-44ee-a39b-754facf4b6e7 admin admin] PATH_INFO: `/v3/projects/cc4c533a07064664a9fd2a2c983d60d6/users/cffad12f1d944d30936227c38c9bba22/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.609935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84222b-d8e3-44ee-a39b-754facf4b6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4c533a07064664a9fd2a2c983d60d6, user_id=cffad12f1d944d30936227c38c9bba22, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.612611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84222b-d8e3-44ee-a39b-754facf4b6e7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.624974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1098/2160] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:46 2022] PUT /identity/v3/projects/cc4c533a07064664a9fd2a2c983d60d6/users/cffad12f1d944d30936227c38c9bba22/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:46.636476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93d02-cb04-43e9-894f-d3c846eb0b3d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.636880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93d02-cb04-43e9-894f-d3c846eb0b3d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.637930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93d02-cb04-43e9-894f-d3c846eb0b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.665277 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-54e93d02-cb04-43e9-894f-d3c846eb0b3d None None] MFA Rules not processed for user `cffad12f1d944d30936227c38c9bba22`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:46.666494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-54e93d02-cb04-43e9-894f-d3c846eb0b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:46.729326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1063/2161] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:46.733859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84222b-d8e3-44ee-a39b-754facf4b6e7 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.795359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84222b-d8e3-44ee-a39b-754facf4b6e7 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.799967 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1fbe5-4ed1-4c64-88de-cf2da11d2cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.800579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1fbe5-4ed1-4c64-88de-cf2da11d2cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.800863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1fbe5-4ed1-4c64-88de-cf2da11d2cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.801140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1fbe5-4ed1-4c64-88de-cf2da11d2cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.801821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1fbe5-4ed1-4c64-88de-cf2da11d2cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.803827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1fbe5-4ed1-4c64-88de-cf2da11d2cb1 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.829609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1099/2162] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:53:46 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:53:46.833818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e93d02-cb04-43e9-894f-d3c846eb0b3d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.846326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e93d02-cb04-43e9-894f-d3c846eb0b3d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.904364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585005bb-89dd-40f0-baaf-38d2971ccfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.904986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585005bb-89dd-40f0-baaf-38d2971ccfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.905271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585005bb-89dd-40f0-baaf-38d2971ccfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.905548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585005bb-89dd-40f0-baaf-38d2971ccfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.906225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585005bb-89dd-40f0-baaf-38d2971ccfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.908192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585005bb-89dd-40f0-baaf-38d2971ccfb6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.928021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1064/2163] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:53:46 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:53:46.932073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1fbe5-4ed1-4c64-88de-cf2da11d2cb1 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.942952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1fbe5-4ed1-4c64-88de-cf2da11d2cb1 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.947522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71686383-873b-45bd-af88-48ce96e406f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.948130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686383-873b-45bd-af88-48ce96e406f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.948412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686383-873b-45bd-af88-48ce96e406f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.948688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71686383-873b-45bd-af88-48ce96e406f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:46.949381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71686383-873b-45bd-af88-48ce96e406f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:46.951680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71686383-873b-45bd-af88-48ce96e406f5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:46.961968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1100/2164] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:46.965961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585005bb-89dd-40f0-baaf-38d2971ccfb6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:46.972245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:46.976409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585005bb-89dd-40f0-baaf-38d2971ccfb6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:46.981957 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e606-68db-4793-b7b8-9ad4327231ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:46.982614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e606-68db-4793-b7b8-9ad4327231ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:46.982897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e606-68db-4793-b7b8-9ad4327231ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:46.983213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e606-68db-4793-b7b8-9ad4327231ab admin admin] PATH_INFO: `/v3/projects/59352a9ef9bd481eba9a7f025d333d3f/users/02f0ed10800b4049b55c663ce0d94caf/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:47.003246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11e606-68db-4793-b7b8-9ad4327231ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=59352a9ef9bd481eba9a7f025d333d3f, user_id=02f0ed10800b4049b55c663ce0d94caf, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:47.005804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11e606-68db-4793-b7b8-9ad4327231ab admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:47.019109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1065/2165] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:46 2022] PUT /identity/v3/projects/59352a9ef9bd481eba9a7f025d333d3f/users/02f0ed10800b4049b55c663ce0d94caf/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:47.022921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71686383-873b-45bd-af88-48ce96e406f5 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:47.032720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71686383-873b-45bd-af88-48ce96e406f5 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:47.087215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef078f6a-37a8-4dd6-930a-df1fa59aa8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:47.087825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef078f6a-37a8-4dd6-930a-df1fa59aa8cf admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:47.088162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef078f6a-37a8-4dd6-930a-df1fa59aa8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:47.088400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef078f6a-37a8-4dd6-930a-df1fa59aa8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:47.089062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef078f6a-37a8-4dd6-930a-df1fa59aa8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:47.090690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef078f6a-37a8-4dd6-930a-df1fa59aa8cf admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:47.100317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1101/2166] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:53:47.104368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e606-68db-4793-b7b8-9ad4327231ab admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:47.114228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e606-68db-4793-b7b8-9ad4327231ab admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:47.118726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:47.119408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:47.119686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:47.119958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] PATH_INFO: `/v3/projects/59352a9ef9bd481eba9a7f025d333d3f/users/02f0ed10800b4049b55c663ce0d94caf/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:47.122396 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59352a9ef9bd481eba9a7f025d333d3f, user_id=02f0ed10800b4049b55c663ce0d94caf, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:47.125021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:47.135197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1066/2167] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:53:47 2022] PUT /identity/v3/projects/59352a9ef9bd481eba9a7f025d333d3f/users/02f0ed10800b4049b55c663ce0d94caf/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:53:47.145861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde313-3689-4272-9ec1-a22b0c6701a1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:47.146144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde313-3689-4272-9ec1-a22b0c6701a1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:47.146419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde313-3689-4272-9ec1-a22b0c6701a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:47.173859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-81bde313-3689-4272-9ec1-a22b0c6701a1 None None] MFA Rules not processed for user `02f0ed10800b4049b55c663ce0d94caf`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:53:47.175105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-81bde313-3689-4272-9ec1-a22b0c6701a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:47.207356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:47.247324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1102/2168] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:53:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:53:47.258621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:47.260284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:53:47.319538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fb326-daab-4939-8c11-dc3d8eafe5e9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:47.323308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:47.323924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:47.324208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:47.324549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:47.333960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:47.335448 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:47.345163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1067/2169] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:47.421913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde313-3689-4272-9ec1-a22b0c6701a1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:53:47.431304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde313-3689-4272-9ec1-a22b0c6701a1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:53:47.434839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba3728-57cc-490e-aef9-bbfb7b660b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:53:47.435525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3728-57cc-490e-aef9-bbfb7b660b7b service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:53:47.436383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3728-57cc-490e-aef9-bbfb7b660b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:53:47.436656 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3728-57cc-490e-aef9-bbfb7b660b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:53:47.493573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba3728-57cc-490e-aef9-bbfb7b660b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:53:47.495083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba3728-57cc-490e-aef9-bbfb7b660b7b service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:53:47.504818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1103/2170] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:53:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:53:57.340806 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:53:57.500575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=43 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:08.967072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:08.968560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:09.046577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe778a5-1ad6-4600-9775-6c109a60b0dd service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:09.051921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:09.052571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:09.052855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:09.053134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] PATH_INFO: `/v3/users/d1bb723c4b3246029e0f0c6d791d6332` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:09.054410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bb723c4b3246029e0f0c6d791d6332)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:09.056379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:09.103876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bb723c4b3246029e0f0c6d791d6332'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.111527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bb723c4b3246029e0f0c6d791d6332'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.112241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bb723c4b3246029e0f0c6d791d6332'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.124173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bb723c4b3246029e0f0c6d791d6332'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.124847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bb723c4b3246029e0f0c6d791d6332'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.138508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1068/2171] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:54:08 2022] DELETE /identity/v3/users/d1bb723c4b3246029e0f0c6d791d6332 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:54:09.143377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240689f-5f4f-4bda-9c5d-4ca541023e6d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:09.143856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240689f-5f4f-4bda-9c5d-4ca541023e6d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:09.143992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240689f-5f4f-4bda-9c5d-4ca541023e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:09.164034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-1240689f-5f4f-4bda-9c5d-4ca541023e6d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:09.165247 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1240689f-5f4f-4bda-9c5d-4ca541023e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:09.224737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1104/2172] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:09.235277 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:09.236775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:09.298144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127ce0b-d635-47d8-b73c-9ffb14eae6e0 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:09.301836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ac9bd-6c37-4ac8-85f1-c6ca2ea77b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:09.302457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac9bd-6c37-4ac8-85f1-c6ca2ea77b79 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:09.302742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac9bd-6c37-4ac8-85f1-c6ca2ea77b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:09.303061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac9bd-6c37-4ac8-85f1-c6ca2ea77b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:09.312181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ac9bd-6c37-4ac8-85f1-c6ca2ea77b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:09.313898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ac9bd-6c37-4ac8-85f1-c6ca2ea77b79 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:09.324336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1069/2173] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:54:09.636122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240689f-5f4f-4bda-9c5d-4ca541023e6d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:09.637884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1240689f-5f4f-4bda-9c5d-4ca541023e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:09.650475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240689f-5f4f-4bda-9c5d-4ca541023e6d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:09.655666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:09.657326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:09.657326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:09.657572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] PATH_INFO: `/v3/projects/2b165392bdcc408f97099bd7bbcb4483` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:09.658716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b165392bdcc408f97099bd7bbcb4483)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:09.660665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:09.708022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b165392bdcc408f97099bd7bbcb4483', 'request_id': 'req-83abbedf-6347-4ca1-abd4-123ad9167403'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.715160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b165392bdcc408f97099bd7bbcb4483', 'request_id': 'req-83abbedf-6347-4ca1-abd4-123ad9167403'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.721118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b165392bdcc408f97099bd7bbcb4483', 'request_id': 'req-83abbedf-6347-4ca1-abd4-123ad9167403'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.732029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] The token cache is being invalidate because project 2b165392bdcc408f97099bd7bbcb4483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:54:09.732318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.732947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-83abbedf-6347-4ca1-abd4-123ad9167403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:09.734489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1105/2174] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:54:09 2022] DELETE /identity/v3/projects/2b165392bdcc408f97099bd7bbcb4483 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:54:09.739385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b784-b1f0-4348-a5c6-56461f945b46 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:09.739681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b784-b1f0-4348-a5c6-56461f945b46 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:09.739967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b784-b1f0-4348-a5c6-56461f945b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:09.759705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-2db9b784-b1f0-4348-a5c6-56461f945b46 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:09.760920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2db9b784-b1f0-4348-a5c6-56461f945b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:09.778462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:09.824311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1070/2175] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:09.832765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ee87-920b-46b3-bf9a-6a42ed042ebc None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:09.833059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ee87-920b-46b3-bf9a-6a42ed042ebc None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:09.833336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2ee87-920b-46b3-bf9a-6a42ed042ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:09.854152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5ea2ee87-920b-46b3-bf9a-6a42ed042ebc None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:09.855411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5ea2ee87-920b-46b3-bf9a-6a42ed042ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:09.863450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1106/2176] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:09.867734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b784-b1f0-4348-a5c6-56461f945b46 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:09.877410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b784-b1f0-4348-a5c6-56461f945b46 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:09.882025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:09.882704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:09.882908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:09.883210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:09.883907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:54:09.884214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:09.885820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:09.898905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1071/2177] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:54:09.903224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2ee87-920b-46b3-bf9a-6a42ed042ebc None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:09.913046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2ee87-920b-46b3-bf9a-6a42ed042ebc None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:09.917727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6b09e-0692-4d3a-b733-f050bfdf8f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:09.918368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6b09e-0692-4d3a-b733-f050bfdf8f64 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:09.918651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6b09e-0692-4d3a-b733-f050bfdf8f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:09.918950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6b09e-0692-4d3a-b733-f050bfdf8f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:09.919635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6b09e-0692-4d3a-b733-f050bfdf8f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:09.921536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6b09e-0692-4d3a-b733-f050bfdf8f64 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:09.949288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1107/2178] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:54:09 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:54:09.953917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:09.964627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d21476-159d-4c68-a4f0-83722077a2f8 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:10.023259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe082-5df7-45d4-bd84-edaf6fd2df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:10.024001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe082-5df7-45d4-bd84-edaf6fd2df61 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:10.024348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe082-5df7-45d4-bd84-edaf6fd2df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:10.024687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe082-5df7-45d4-bd84-edaf6fd2df61 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:10.025490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe082-5df7-45d4-bd84-edaf6fd2df61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:10.028924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe082-5df7-45d4-bd84-edaf6fd2df61 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:10.050151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1072/2179] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:54:09 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:54:10.054378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6b09e-0692-4d3a-b733-f050bfdf8f64 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:10.065364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6b09e-0692-4d3a-b733-f050bfdf8f64 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:10.069946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ba67-18a9-4053-bf6b-ea76e1d45226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:10.070565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ba67-18a9-4053-bf6b-ea76e1d45226 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:10.070840 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ba67-18a9-4053-bf6b-ea76e1d45226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:10.071147 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ba67-18a9-4053-bf6b-ea76e1d45226 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:10.071870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866ba67-18a9-4053-bf6b-ea76e1d45226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:10.073459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866ba67-18a9-4053-bf6b-ea76e1d45226 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:10.083870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1108/2180] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:54:10.087582 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe082-5df7-45d4-bd84-edaf6fd2df61 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:10.097290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe082-5df7-45d4-bd84-edaf6fd2df61 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:10.102303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ea61-df5e-4b12-8702-a5d1a143f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:10.102922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ea61-df5e-4b12-8702-a5d1a143f6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:10.103247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ea61-df5e-4b12-8702-a5d1a143f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:10.103509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ea61-df5e-4b12-8702-a5d1a143f6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:10.104220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2ea61-df5e-4b12-8702-a5d1a143f6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:10.105827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2ea61-df5e-4b12-8702-a5d1a143f6f0 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:10.117055 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1073/2181] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:54:10.121716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ba67-18a9-4053-bf6b-ea76e1d45226 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:10.132318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ba67-18a9-4053-bf6b-ea76e1d45226 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:10.137198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:10.137858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:10.138144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:10.138422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] PATH_INFO: `/v3/projects/5ab815ef16734e92853592e336fe0fd9/users/d24c622b69c44adc809641c4bb977771/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:10.153992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab815ef16734e92853592e336fe0fd9, user_id=d24c622b69c44adc809641c4bb977771, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:10.156809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:10.170911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1109/2182] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:54:10 2022] PUT /identity/v3/projects/5ab815ef16734e92853592e336fe0fd9/users/d24c622b69c44adc809641c4bb977771/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:54:10.182206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a70e5-907d-4049-8a51-b4fc53eb987a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:10.182496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a70e5-907d-4049-8a51-b4fc53eb987a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:10.182780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a70e5-907d-4049-8a51-b4fc53eb987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:10.210815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8a1a70e5-907d-4049-8a51-b4fc53eb987a None None] MFA Rules not processed for user `d24c622b69c44adc809641c4bb977771`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:10.212114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8a1a70e5-907d-4049-8a51-b4fc53eb987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:10.279158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1074/2183] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:10.290260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:10.292078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:10.314675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:10.355209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320cb9f-9e09-4ba1-9017-b47d4027a292 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:10.358921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:10.360103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:10.360388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:10.360664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:10.369254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:10.370814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:10.380035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1110/2184] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:54:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:54:20.275878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:20.375933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=17 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:38.151619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc717e-9abe-4d4c-9305-7bfb35fbb14d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:38.152090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc717e-9abe-4d4c-9305-7bfb35fbb14d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:38.152184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc717e-9abe-4d4c-9305-7bfb35fbb14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:38.172592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8afc717e-9abe-4d4c-9305-7bfb35fbb14d None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:38.173861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8afc717e-9abe-4d4c-9305-7bfb35fbb14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:38.229502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1075/2185] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:54:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:38.269887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:38.271397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:38.341503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6e4c0-5e86-4102-b068-f2a355cc02f6 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:38.347330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb7dd-cdb8-4f5b-8db7-a68319487ecf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:38.347944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb7dd-cdb8-4f5b-8db7-a68319487ecf service swift] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:38.348222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb7dd-cdb8-4f5b-8db7-a68319487ecf service swift] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:38.348495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb7dd-cdb8-4f5b-8db7-a68319487ecf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:38.357165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedb7dd-cdb8-4f5b-8db7-a68319487ecf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:38.358751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedb7dd-cdb8-4f5b-8db7-a68319487ecf service swift] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:38.366660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1111/2186] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:54:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:54:39.464894 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc717e-9abe-4d4c-9305-7bfb35fbb14d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:39.466505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8afc717e-9abe-4d4c-9305-7bfb35fbb14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:39.544694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc717e-9abe-4d4c-9305-7bfb35fbb14d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:39.550416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:39.551109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:39.551395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:39.551719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] PATH_INFO: `/v3/users/b314cef999d141fba07d1cc1ab77297f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:39.552929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b314cef999d141fba07d1cc1ab77297f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:39.554867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:39.601321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b314cef999d141fba07d1cc1ab77297f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:39.608045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b314cef999d141fba07d1cc1ab77297f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:39.608721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b314cef999d141fba07d1cc1ab77297f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:39.622477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b314cef999d141fba07d1cc1ab77297f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:39.623425 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b314cef999d141fba07d1cc1ab77297f'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:39.638524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1076/2187] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:54:39 2022] DELETE /identity/v3/users/b314cef999d141fba07d1cc1ab77297f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:54:39.643469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a6b9-cedd-486f-849c-7a71571f4c5c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:39.644010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a6b9-cedd-486f-849c-7a71571f4c5c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:39.644010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a6b9-cedd-486f-849c-7a71571f4c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:39.663699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9468a6b9-cedd-486f-849c-7a71571f4c5c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:39.665019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9468a6b9-cedd-486f-849c-7a71571f4c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:39.725354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1112/2188] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:39.735168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:39.737427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:39.770311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:39.802525 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96821012-ebfb-4470-944d-465ff6c902aa admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:39.806517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e785ce4-5f8d-424e-9820-ec6fcf04303a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:39.807171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e785ce4-5f8d-424e-9820-ec6fcf04303a service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:39.807459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e785ce4-5f8d-424e-9820-ec6fcf04303a service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:39.807753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e785ce4-5f8d-424e-9820-ec6fcf04303a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:39.818748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e785ce4-5f8d-424e-9820-ec6fcf04303a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:39.820556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e785ce4-5f8d-424e-9820-ec6fcf04303a service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:39.830376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1077/2189] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:54:40.234816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468a6b9-cedd-486f-849c-7a71571f4c5c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:40.236563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9468a6b9-cedd-486f-849c-7a71571f4c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:40.267179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468a6b9-cedd-486f-849c-7a71571f4c5c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:40.274782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:40.275545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:40.275917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:40.276279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] PATH_INFO: `/v3/projects/f500984c7c7e46609b077d3117b1062c` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:40.278426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f500984c7c7e46609b077d3117b1062c)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:40.280619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:40.364162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f500984c7c7e46609b077d3117b1062c', 'request_id': 'req-facf99c5-47d9-452b-8bc9-26249dc1d124'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.378428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f500984c7c7e46609b077d3117b1062c', 'request_id': 'req-facf99c5-47d9-452b-8bc9-26249dc1d124'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.387462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f500984c7c7e46609b077d3117b1062c', 'request_id': 'req-facf99c5-47d9-452b-8bc9-26249dc1d124'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.402608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] The token cache is being invalidate because project f500984c7c7e46609b077d3117b1062c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:54:40.402901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.403625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.405812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1113/2190] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:54:40 2022] DELETE /identity/v3/projects/f500984c7c7e46609b077d3117b1062c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:54:40.410578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2df78-55e8-42fb-a316-09135046a4c0 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:40.410876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2df78-55e8-42fb-a316-09135046a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:40.411185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2df78-55e8-42fb-a316-09135046a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:40.456527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-bfa2df78-55e8-42fb-a316-09135046a4c0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:40.465721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-bfa2df78-55e8-42fb-a316-09135046a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:40.505521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:40.507821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:40.539087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:40.587395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1078/2191] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:40.605671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8f73-b657-47b7-9d6a-9726285b6bc6 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:40.611645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8f73-b657-47b7-9d6a-9726285b6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:40.611645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8f73-b657-47b7-9d6a-9726285b6bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:40.681900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ee0c8f73-b657-47b7-9d6a-9726285b6bc6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:40.683727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ee0c8f73-b657-47b7-9d6a-9726285b6bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:40.685421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf99c5-47d9-452b-8bc9-26249dc1d124 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:40.699515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1079/2192] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:40.701188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:40.701416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8f73-b657-47b7-9d6a-9726285b6bc6 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:40.702260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:40.702790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:40.703255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] PATH_INFO: `/v3/users/d24c622b69c44adc809641c4bb977771` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:40.706087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24c622b69c44adc809641c4bb977771)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:40.708369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:40.755394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8f73-b657-47b7-9d6a-9726285b6bc6 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:40.766487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:40.767347 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:40.768323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:40.768505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:40.769270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:54:40.769645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:40.772080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:40.792145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1080/2193] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:54:40.796505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:40.799023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24c622b69c44adc809641c4bb977771'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.811910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24c622b69c44adc809641c4bb977771'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.812206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c811b0-d86b-48a2-a44d-b24c66d8378f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:40.823558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:40.824388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:40.824675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:40.824976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:40.825664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:40.827775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:40.839097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24c622b69c44adc809641c4bb977771'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.840033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24c622b69c44adc809641c4bb977771'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.859038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-1f1e1416-c909-4d44-9a81-2ea42559d454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24c622b69c44adc809641c4bb977771'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:40.865572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1114/2194] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:54:40 2022] DELETE /identity/v3/users/d24c622b69c44adc809641c4bb977771 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:54:40.866130 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1081/2195] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:54:40 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:54:40.870529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59450f0-c710-424b-a3e3-f1adb56781af None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:40.870824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59450f0-c710-424b-a3e3-f1adb56781af None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:40.871139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59450f0-c710-424b-a3e3-f1adb56781af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:40.871999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:40.873816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:40.894405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b59450f0-c710-424b-a3e3-f1adb56781af None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:40.895754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b59450f0-c710-424b-a3e3-f1adb56781af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:40.952319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e391a5-2d93-4fc4-b9ba-c861ab3de348 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:40.957615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdd4e0-3f1e-4f2f-b4ca-4f7582f13021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:40.958241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdd4e0-3f1e-4f2f-b4ca-4f7582f13021 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:40.961535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1115/2196] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:40.961696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdd4e0-3f1e-4f2f-b4ca-4f7582f13021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:40.961696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdd4e0-3f1e-4f2f-b4ca-4f7582f13021 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:40.961696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdd4e0-3f1e-4f2f-b4ca-4f7582f13021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:40.961696 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdd4e0-3f1e-4f2f-b4ca-4f7582f13021 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:40.968044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59450f0-c710-424b-a3e3-f1adb56781af None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:40.969437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b59450f0-c710-424b-a3e3-f1adb56781af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:40.986153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1082/2197] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:54:40 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:54:40.987350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdd4e0-3f1e-4f2f-b4ca-4f7582f13021 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:40.998961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdd4e0-3f1e-4f2f-b4ca-4f7582f13021 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:41.004286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c10b8-c277-4523-a2bd-1a9c2daaa9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:41.004889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c10b8-c277-4523-a2bd-1a9c2daaa9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:41.005176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c10b8-c277-4523-a2bd-1a9c2daaa9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:41.005459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c10b8-c277-4523-a2bd-1a9c2daaa9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:41.006044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:41.006175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c10b8-c277-4523-a2bd-1a9c2daaa9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:41.007903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c10b8-c277-4523-a2bd-1a9c2daaa9a6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:41.022725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1083/2198] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:54:41.023754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c10b8-c277-4523-a2bd-1a9c2daaa9a6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:41.030397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:41.030743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59450f0-c710-424b-a3e3-f1adb56781af None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:41.034468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c10b8-c277-4523-a2bd-1a9c2daaa9a6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:41.034769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94fe76-aa99-4070-bc54-c329026ea067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:41.035448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fe76-aa99-4070-bc54-c329026ea067 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:41.035763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fe76-aa99-4070-bc54-c329026ea067 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:41.036042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fe76-aa99-4070-bc54-c329026ea067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:41.040506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb6908-9a25-4679-871c-c818b5f366f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:41.041350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6908-9a25-4679-871c-c818b5f366f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:41.041893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6908-9a25-4679-871c-c818b5f366f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:41.042221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6908-9a25-4679-871c-c818b5f366f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:41.042920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb6908-9a25-4679-871c-c818b5f366f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:41.044650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb6908-9a25-4679-871c-c818b5f366f2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:41.046673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94fe76-aa99-4070-bc54-c329026ea067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:41.048151 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94fe76-aa99-4070-bc54-c329026ea067 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:41.060468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1084/2199] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:54:41.060641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1116/2200] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:54:41.061904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb6908-9a25-4679-871c-c818b5f366f2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:41.072100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb6908-9a25-4679-871c-c818b5f366f2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:41.077972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:41.078848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:41.079336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:41.079759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] PATH_INFO: `/v3/projects/1eeaa9a816f3498c9bff9d77a3cf29ea/users/7e2632fdee354f169d060f90eca1dfe3/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:41.104342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eeaa9a816f3498c9bff9d77a3cf29ea, user_id=7e2632fdee354f169d060f90eca1dfe3, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:41.108121 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:41.128437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1085/2201] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:54:41 2022] PUT /identity/v3/projects/1eeaa9a816f3498c9bff9d77a3cf29ea/users/7e2632fdee354f169d060f90eca1dfe3/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:54:41.140671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499111-9b8c-4456-80ab-b671533c15e1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:41.141301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499111-9b8c-4456-80ab-b671533c15e1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:41.141681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499111-9b8c-4456-80ab-b671533c15e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:41.176611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8a499111-9b8c-4456-80ab-b671533c15e1 None None] MFA Rules not processed for user `7e2632fdee354f169d060f90eca1dfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:41.178007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8a499111-9b8c-4456-80ab-b671533c15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:41.263351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1117/2202] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:54:41.275195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:41.277127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:41.359482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218cf9e-fef4-4feb-8ffe-aa4444bd6631 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:41.363474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf45f3e-ecc4-4529-8736-add7775c6c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:41.365179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf45f3e-ecc4-4529-8736-add7775c6c3c service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:41.365486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf45f3e-ecc4-4529-8736-add7775c6c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:41.366541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf45f3e-ecc4-4529-8736-add7775c6c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:41.383589 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf45f3e-ecc4-4529-8736-add7775c6c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:41.385057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf45f3e-ecc4-4529-8736-add7775c6c3c service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:41.400034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1086/2203] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:54:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:54:41.434236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499111-9b8c-4456-80ab-b671533c15e1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:54:41.436794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8a499111-9b8c-4456-80ab-b671533c15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:41.538721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499111-9b8c-4456-80ab-b671533c15e1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:54:41.543831 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:54:41.544490 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:41.545355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:41.545355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] PATH_INFO: `/v3/projects/5ab815ef16734e92853592e336fe0fd9` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:41.546637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab815ef16734e92853592e336fe0fd9)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:54:41.548715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:54:41.631878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab815ef16734e92853592e336fe0fd9', 'request_id': 'req-8237bccc-f94f-4b48-adae-33214a139596'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:41.654165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab815ef16734e92853592e336fe0fd9', 'request_id': 'req-8237bccc-f94f-4b48-adae-33214a139596'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:41.660895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab815ef16734e92853592e336fe0fd9', 'request_id': 'req-8237bccc-f94f-4b48-adae-33214a139596'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:41.663216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:41.693169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] The token cache is being invalidate because project 5ab815ef16734e92853592e336fe0fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:54:41.693882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:41.694799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-8237bccc-f94f-4b48-adae-33214a139596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:54:41.700793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1118/2204] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:54:41 2022] DELETE /identity/v3/projects/5ab815ef16734e92853592e336fe0fd9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:54:43.338556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aba02-58af-4414-bf7a-eeea91ef09d5 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:54:43.339169 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aba02-58af-4414-bf7a-eeea91ef09d5 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:54:43.339925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aba02-58af-4414-bf7a-eeea91ef09d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:54:43.379929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c57aba02-58af-4414-bf7a-eeea91ef09d5 None None] MFA Rules not processed for user `0db0b77cc6ef4b8aa20d0304ec99e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:54:43.381456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c57aba02-58af-4414-bf7a-eeea91ef09d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:54:43.482046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1087/2205] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:54:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:54:51.689162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:54:53.468673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:01.280937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2a7bf-0f90-4ded-a060-39431dacb9e4 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:01.281550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2a7bf-0f90-4ded-a060-39431dacb9e4 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:01.281550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2a7bf-0f90-4ded-a060-39431dacb9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:01.300928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-14b2a7bf-0f90-4ded-a060-39431dacb9e4 None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:01.302158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-14b2a7bf-0f90-4ded-a060-39431dacb9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:01.355796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1119/2206] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jul 26 07:55:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:01.368619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aba02-58af-4414-bf7a-eeea91ef09d5 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:01.370031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c57aba02-58af-4414-bf7a-eeea91ef09d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:01.442223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aba02-58af-4414-bf7a-eeea91ef09d5 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:01.447197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:01.447815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:01.448100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:01.448379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:01.456346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:01.457917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:01.466044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1088/2207] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:55:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:55:07.515805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2a7bf-0f90-4ded-a060-39431dacb9e4 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:07.517408 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-14b2a7bf-0f90-4ded-a060-39431dacb9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:07.591120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2a7bf-0f90-4ded-a060-39431dacb9e4 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:07.596539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:07.597452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:07.598559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:07.598960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] PATH_INFO: `/v3/users/cffad12f1d944d30936227c38c9bba22` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:07.600327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffad12f1d944d30936227c38c9bba22)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:07.602368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:07.624367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:07.628617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:07.686205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffad12f1d944d30936227c38c9bba22'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.699352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffad12f1d944d30936227c38c9bba22'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.711101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffad12f1d944d30936227c38c9bba22'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.711928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffad12f1d944d30936227c38c9bba22'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.737205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffad12f1d944d30936227c38c9bba22'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.743333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c84c-e61b-438a-80dd-77dcf3076c2f service swift] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:07.745114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1120/2208] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:55:07 2022] DELETE /identity/v3/users/cffad12f1d944d30936227c38c9bba22 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:07.746388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:07.748040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:07.777418 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:07.807814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb5e6-5035-4ca4-9f6f-8c8e46f0a130 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:07.808358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb5e6-5035-4ca4-9f6f-8c8e46f0a130 service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:07.808622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb5e6-5035-4ca4-9f6f-8c8e46f0a130 service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:07.808893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb5e6-5035-4ca4-9f6f-8c8e46f0a130 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:07.810921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7b4fb5e6-5035-4ca4-9f6f-8c8e46f0a130 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:07.819696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb446e0e-9829-4605-9f5a-21df145ce667 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:07.822966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb5e6-5035-4ca4-9f6f-8c8e46f0a130 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:07.824551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb5e6-5035-4ca4-9f6f-8c8e46f0a130 service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:07.824941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:07.825590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:07.825866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:07.826144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] PATH_INFO: `/v3/users/083dbcc58259466095bc2f37f7d2c283` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:07.827383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083dbcc58259466095bc2f37f7d2c283)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:07.829290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:07.835025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1089/2209] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:55:07.836537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2d28-b4e1-4b72-8b21-a32086170e80 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:07.836826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2d28-b4e1-4b72-8b21-a32086170e80 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:07.837099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2d28-b4e1-4b72-8b21-a32086170e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:07.864616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d53e2d28-b4e1-4b72-8b21-a32086170e80 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:07.866144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d53e2d28-b4e1-4b72-8b21-a32086170e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:07.876433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1090/2210] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:07.887435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2d28-b4e1-4b72-8b21-a32086170e80 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:07.888832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d53e2d28-b4e1-4b72-8b21-a32086170e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:07.891627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083dbcc58259466095bc2f37f7d2c283'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.900843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083dbcc58259466095bc2f37f7d2c283'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.911718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083dbcc58259466095bc2f37f7d2c283'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.912451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:07.913628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083dbcc58259466095bc2f37f7d2c283'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.928765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083dbcc58259466095bc2f37f7d2c283'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:07.935869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1121/2211] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:55:07 2022] DELETE /identity/v3/users/083dbcc58259466095bc2f37f7d2c283 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:07.953029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2d28-b4e1-4b72-8b21-a32086170e80 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.009321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d9353-da48-49da-8afd-3f9bdcff5ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.010027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9353-da48-49da-8afd-3f9bdcff5ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.010422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9353-da48-49da-8afd-3f9bdcff5ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.010854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9353-da48-49da-8afd-3f9bdcff5ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.013158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d66d9353-da48-49da-8afd-3f9bdcff5ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.084134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d9353-da48-49da-8afd-3f9bdcff5ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.086023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d9353-da48-49da-8afd-3f9bdcff5ce2 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.097944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1091/2212] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:08.191995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.193478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.207839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2edb-5cf3-4ae1-b14e-1ef6ee0d4e31 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.213091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.213777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.214067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.214346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] PATH_INFO: `/v3/projects/683afbec3da846dca5198a1f1579152e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.215593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] RBAC: Authorizing `identity:delete_project(project_id=683afbec3da846dca5198a1f1579152e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.217530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.271737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683afbec3da846dca5198a1f1579152e', 'request_id': 'req-c6654dbf-6d12-46ba-a2d8-439140ed077c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.280276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683afbec3da846dca5198a1f1579152e', 'request_id': 'req-c6654dbf-6d12-46ba-a2d8-439140ed077c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.286742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683afbec3da846dca5198a1f1579152e', 'request_id': 'req-c6654dbf-6d12-46ba-a2d8-439140ed077c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.300722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] The token cache is being invalidate because project 683afbec3da846dca5198a1f1579152e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:55:08.300959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.302189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c6654dbf-6d12-46ba-a2d8-439140ed077c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.309135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1122/2213] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:55:08 2022] DELETE /identity/v3/projects/683afbec3da846dca5198a1f1579152e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:55:08.310624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695ea5-02b2-4d85-aeb3-00235bd96954 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.310950 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695ea5-02b2-4d85-aeb3-00235bd96954 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.311257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695ea5-02b2-4d85-aeb3-00235bd96954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.332766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8f695ea5-02b2-4d85-aeb3-00235bd96954 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:08.334081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8f695ea5-02b2-4d85-aeb3-00235bd96954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.404652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1092/2214] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:08.416302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03c95-c5ff-4e94-a1fc-9ddf15f5769a None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.416570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03c95-c5ff-4e94-a1fc-9ddf15f5769a None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.416874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03c95-c5ff-4e94-a1fc-9ddf15f5769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.437419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-94a03c95-c5ff-4e94-a1fc-9ddf15f5769a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:08.438722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-94a03c95-c5ff-4e94-a1fc-9ddf15f5769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.441103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f695ea5-02b2-4d85-aeb3-00235bd96954 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.442656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8f695ea5-02b2-4d85-aeb3-00235bd96954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.448401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1123/2215] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:08.452560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03c95-c5ff-4e94-a1fc-9ddf15f5769a None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.461152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f695ea5-02b2-4d85-aeb3-00235bd96954 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.462727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03c95-c5ff-4e94-a1fc-9ddf15f5769a None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.465987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.466680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.466863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.467163 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] PATH_INFO: `/v3/projects/cc4c533a07064664a9fd2a2c983d60d6` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.468354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4c533a07064664a9fd2a2c983d60d6)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.470324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.475356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.476011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.476292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.476678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.477436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:55:08.477746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.479379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.489094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:08.492365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1124/2216] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 07:55:08.496671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.507472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fd19-22d0-430d-b483-f1e7c759a4c7 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.512408 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37c8d3-c9e5-4004-af83-68a0e5a605bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.513008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37c8d3-c9e5-4004-af83-68a0e5a605bf admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.513292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37c8d3-c9e5-4004-af83-68a0e5a605bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.513571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37c8d3-c9e5-4004-af83-68a0e5a605bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.514259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37c8d3-c9e5-4004-af83-68a0e5a605bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.516191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37c8d3-c9e5-4004-af83-68a0e5a605bf admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.521494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:08.529478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4c533a07064664a9fd2a2c983d60d6', 'request_id': 'req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.537188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4c533a07064664a9fd2a2c983d60d6', 'request_id': 'req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.544316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4c533a07064664a9fd2a2c983d60d6', 'request_id': 'req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.547190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1125/2217] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:55:08 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:55:08.551465 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37c8d3-c9e5-4004-af83-68a0e5a605bf admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.556068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] The token cache is being invalidate because project cc4c533a07064664a9fd2a2c983d60d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:55:08.556362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.557027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.558577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1093/2218] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:55:08 2022] DELETE /identity/v3/projects/cc4c533a07064664a9fd2a2c983d60d6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:08.562362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.563683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.619468 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37c8d3-c9e5-4004-af83-68a0e5a605bf admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.624422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.625034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.625433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.625715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.626418 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.629280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.634355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef927de-f7e2-4080-b3ff-ccd399ae2a76 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.642651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.643355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.643638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.643923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] PATH_INFO: `/v3/users/02f0ed10800b4049b55c663ce0d94caf` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.645423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f0ed10800b4049b55c663ce0d94caf)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.647423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.658820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1126/2219] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:55:08 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:55:08.664687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.666561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.681170 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ef960-8359-41dc-a7f4-c9361f2b443b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.687286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632b86-3857-46ad-bd63-002b2bc89707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.688164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632b86-3857-46ad-bd63-002b2bc89707 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.688527 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632b86-3857-46ad-bd63-002b2bc89707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.688811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632b86-3857-46ad-bd63-002b2bc89707 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.689551 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a632b86-3857-46ad-bd63-002b2bc89707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.691240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a632b86-3857-46ad-bd63-002b2bc89707 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.705395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f0ed10800b4049b55c663ce0d94caf'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.705577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1127/2220] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:55:08.706975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632b86-3857-46ad-bd63-002b2bc89707 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.710414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f0ed10800b4049b55c663ce0d94caf'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.711133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f0ed10800b4049b55c663ce0d94caf'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.717246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632b86-3857-46ad-bd63-002b2bc89707 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.723319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.724033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.724333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.724590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.725296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.726619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f0ed10800b4049b55c663ce0d94caf'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.726919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.727462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-5670006d-c784-4186-b023-518977bf8fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f0ed10800b4049b55c663ce0d94caf'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:08.740886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1128/2221] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:55:08.742664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1094/2222] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:55:08 2022] DELETE /identity/v3/users/02f0ed10800b4049b55c663ce0d94caf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:55:08.744835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.748211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.763286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243eb75-3788-4074-ac0a-3d9e384e587e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:08.831787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:08.832734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.833280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.833559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] PATH_INFO: `/v3/projects/9fcfa639dca64a8c889a13e92ae5e57f/users/3c58a61adbd74ae58da8dec020922451/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.853076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcfa639dca64a8c889a13e92ae5e57f, user_id=3c58a61adbd74ae58da8dec020922451, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:08.855852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:08.870669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1129/2223] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:08 2022] PUT /identity/v3/projects/9fcfa639dca64a8c889a13e92ae5e57f/users/3c58a61adbd74ae58da8dec020922451/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:55:08.876580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030b16-3b68-4cd1-a632-8aba8f97e4b6 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:08.876580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030b16-3b68-4cd1-a632-8aba8f97e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:08.876580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030b16-3b68-4cd1-a632-8aba8f97e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:08.899264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-de030b16-3b68-4cd1-a632-8aba8f97e4b6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:08.900383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-de030b16-3b68-4cd1-a632-8aba8f97e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:08.922418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:08.973348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1095/2224] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:55:08.983399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:08.985592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:09.028829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:09.071335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a2e97-3c34-4db9-8061-e9b80b9f6594 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.077724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de030b16-3b68-4cd1-a632-8aba8f97e4b6 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:09.079240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-de030b16-3b68-4cd1-a632-8aba8f97e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:09.099906 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0fa9b-1c11-42ba-b0c7-462a3f4287bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.100984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0fa9b-1c11-42ba-b0c7-462a3f4287bd service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.101287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0fa9b-1c11-42ba-b0c7-462a3f4287bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.102196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0fa9b-1c11-42ba-b0c7-462a3f4287bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.104848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de030b16-3b68-4cd1-a632-8aba8f97e4b6 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.110564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.111844 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.112332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.112981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] PATH_INFO: `/v3/projects/59352a9ef9bd481eba9a7f025d333d3f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.114583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59352a9ef9bd481eba9a7f025d333d3f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:09.114870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0fa9b-1c11-42ba-b0c7-462a3f4287bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:09.116568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0fa9b-1c11-42ba-b0c7-462a3f4287bd service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:09.117246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:09.143345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1130/2225] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:09.199953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59352a9ef9bd481eba9a7f025d333d3f', 'request_id': 'req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:09.207842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59352a9ef9bd481eba9a7f025d333d3f', 'request_id': 'req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:09.218502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59352a9ef9bd481eba9a7f025d333d3f', 'request_id': 'req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:09.235936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] The token cache is being invalidate because project 59352a9ef9bd481eba9a7f025d333d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:55:09.236270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:09.236931 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a3107d76-1b62-4cb0-a3d0-aa49030a7b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:09.241972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1096/2226] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:55:09 2022] DELETE /identity/v3/projects/59352a9ef9bd481eba9a7f025d333d3f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:09.244145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7c9e-090e-4c5b-bffa-73d67708f394 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.244603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7c9e-090e-4c5b-bffa-73d67708f394 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.244893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7c9e-090e-4c5b-bffa-73d67708f394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.273775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-661e7c9e-090e-4c5b-bffa-73d67708f394 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:09.275405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-661e7c9e-090e-4c5b-bffa-73d67708f394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:09.350489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1131/2227] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:09.358746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf74a-4d18-4222-8d1f-90321655a3f0 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.359117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf74a-4d18-4222-8d1f-90321655a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.359353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf74a-4d18-4222-8d1f-90321655a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.381890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b1eaf74a-4d18-4222-8d1f-90321655a3f0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:09.383224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b1eaf74a-4d18-4222-8d1f-90321655a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:09.392990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1097/2228] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:09.397451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7c9e-090e-4c5b-bffa-73d67708f394 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:09.407338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7c9e-090e-4c5b-bffa-73d67708f394 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.412090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.412714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.412999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.413277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.414113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:55:09.414425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:09.416080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:09.437634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1132/2229] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:55:09.444454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaf74a-4d18-4222-8d1f-90321655a3f0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:09.458402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaf74a-4d18-4222-8d1f-90321655a3f0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.463835 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54362717-269e-4ac3-9df3-8f0bfc65bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.464468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54362717-269e-4ac3-9df3-8f0bfc65bc5b admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.464752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54362717-269e-4ac3-9df3-8f0bfc65bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.465026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54362717-269e-4ac3-9df3-8f0bfc65bc5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.465800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54362717-269e-4ac3-9df3-8f0bfc65bc5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:09.468457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54362717-269e-4ac3-9df3-8f0bfc65bc5b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:09.511283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1098/2230] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:55:09 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:09.518626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:09.531153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48568-1dac-4a98-83c7-a26d4c03394d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.612066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d5819-5b4a-49db-9af2-6bee5822f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.612706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5819-5b4a-49db-9af2-6bee5822f6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.613049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5819-5b4a-49db-9af2-6bee5822f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.613252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5819-5b4a-49db-9af2-6bee5822f6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.613932 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d5819-5b4a-49db-9af2-6bee5822f6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:09.616745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d5819-5b4a-49db-9af2-6bee5822f6a3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:09.645660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1133/2231] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:55:09 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:09.649632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54362717-269e-4ac3-9df3-8f0bfc65bc5b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:09.665138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54362717-269e-4ac3-9df3-8f0bfc65bc5b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.671799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596f4d9-6946-4c90-8b23-4eed892859be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.673260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f4d9-6946-4c90-8b23-4eed892859be admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.674271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f4d9-6946-4c90-8b23-4eed892859be admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.674741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f4d9-6946-4c90-8b23-4eed892859be admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.676498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596f4d9-6946-4c90-8b23-4eed892859be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:09.678331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596f4d9-6946-4c90-8b23-4eed892859be admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:09.691774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1099/2232] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:55:09.695904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d5819-5b4a-49db-9af2-6bee5822f6a3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:09.706844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d5819-5b4a-49db-9af2-6bee5822f6a3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.711633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e490a0-54a8-4ead-8153-37d5e2dffa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.712254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e490a0-54a8-4ead-8153-37d5e2dffa72 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.712543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e490a0-54a8-4ead-8153-37d5e2dffa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.712822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e490a0-54a8-4ead-8153-37d5e2dffa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.713536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e490a0-54a8-4ead-8153-37d5e2dffa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:09.715331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e490a0-54a8-4ead-8153-37d5e2dffa72 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:09.726580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1134/2233] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:55:09.730748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596f4d9-6946-4c90-8b23-4eed892859be admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:09.741548 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596f4d9-6946-4c90-8b23-4eed892859be admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.746326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6419d2-2ee1-43f3-9d10-dbfb47c79d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.747044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6419d2-2ee1-43f3-9d10-dbfb47c79d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.747321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6419d2-2ee1-43f3-9d10-dbfb47c79d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.747598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6419d2-2ee1-43f3-9d10-dbfb47c79d2e admin admin] PATH_INFO: `/v3/projects/9f76b67ad40540b0b71675f911aec26d/users/8f25eed345ba4764b7340c92bf8e72bb/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.763136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6419d2-2ee1-43f3-9d10-dbfb47c79d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f76b67ad40540b0b71675f911aec26d, user_id=8f25eed345ba4764b7340c92bf8e72bb, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:09.765941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6419d2-2ee1-43f3-9d10-dbfb47c79d2e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:09.780010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1100/2234] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:09 2022] PUT /identity/v3/projects/9f76b67ad40540b0b71675f911aec26d/users/8f25eed345ba4764b7340c92bf8e72bb/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:09.790285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630e46-e734-4f6b-a2a7-d5e210532305 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:09.790996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630e46-e734-4f6b-a2a7-d5e210532305 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:09.790996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630e46-e734-4f6b-a2a7-d5e210532305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:09.820643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-53630e46-e734-4f6b-a2a7-d5e210532305 None None] MFA Rules not processed for user `8f25eed345ba4764b7340c92bf8e72bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:09.821888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-53630e46-e734-4f6b-a2a7-d5e210532305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:09.860434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:09.904825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1135/2235] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:09.909970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6419d2-2ee1-43f3-9d10-dbfb47c79d2e admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:09.970148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:09.992266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6419d2-2ee1-43f3-9d10-dbfb47c79d2e admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:09.999074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c573e-0aed-441c-b2b9-2d85d1a018fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:09.999708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c573e-0aed-441c-b2b9-2d85d1a018fb admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.000506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c573e-0aed-441c-b2b9-2d85d1a018fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.000506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c573e-0aed-441c-b2b9-2d85d1a018fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.000936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c573e-0aed-441c-b2b9-2d85d1a018fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:10.002896 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c573e-0aed-441c-b2b9-2d85d1a018fb admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:10.043355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1101/2236] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:55:09 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:10.047471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53630e46-e734-4f6b-a2a7-d5e210532305 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:10.060662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53630e46-e734-4f6b-a2a7-d5e210532305 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:10.130774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff540-d8b5-4533-9c45-fabfd4086da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:10.131642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff540-d8b5-4533-9c45-fabfd4086da3 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.132642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff540-d8b5-4533-9c45-fabfd4086da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.132999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff540-d8b5-4533-9c45-fabfd4086da3 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.133868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ff540-d8b5-4533-9c45-fabfd4086da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:10.135918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ff540-d8b5-4533-9c45-fabfd4086da3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:10.167176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1136/2237] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:55:10 2022] POST /identity/v3/users => generated 303 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:10.168884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c573e-0aed-441c-b2b9-2d85d1a018fb admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:10.181197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c573e-0aed-441c-b2b9-2d85d1a018fb admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:10.186245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b1df-c64a-400d-a7e6-92577a14a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:10.187057 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b1df-c64a-400d-a7e6-92577a14a487 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.187348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b1df-c64a-400d-a7e6-92577a14a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.187670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b1df-c64a-400d-a7e6-92577a14a487 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.188332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b1df-c64a-400d-a7e6-92577a14a487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:10.190424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b1df-c64a-400d-a7e6-92577a14a487 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:10.202438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1102/2238] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:55:10.206610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff540-d8b5-4533-9c45-fabfd4086da3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:10.217986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff540-d8b5-4533-9c45-fabfd4086da3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:10.226920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c864a3d-27e7-44b2-8967-10a967e727f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:10.228326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864a3d-27e7-44b2-8967-10a967e727f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.228615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864a3d-27e7-44b2-8967-10a967e727f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.229088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864a3d-27e7-44b2-8967-10a967e727f6 admin admin] PATH_INFO: `/v3/projects/58dfc8682000482ba0e8be53757601d9/users/49858af59695497b9df8381ff1fb5add/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.249537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c864a3d-27e7-44b2-8967-10a967e727f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dfc8682000482ba0e8be53757601d9, user_id=49858af59695497b9df8381ff1fb5add, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:10.252866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c864a3d-27e7-44b2-8967-10a967e727f6 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:10.278469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1137/2239] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:10 2022] PUT /identity/v3/projects/58dfc8682000482ba0e8be53757601d9/users/49858af59695497b9df8381ff1fb5add/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:55:10.280245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b1df-c64a-400d-a7e6-92577a14a487 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:10.295298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b1df-c64a-400d-a7e6-92577a14a487 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:10.366745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a785244-066a-4702-9c56-bf635932691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:10.367441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a785244-066a-4702-9c56-bf635932691a admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.367748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a785244-066a-4702-9c56-bf635932691a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.368221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a785244-066a-4702-9c56-bf635932691a admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.368960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a785244-066a-4702-9c56-bf635932691a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:10.370576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a785244-066a-4702-9c56-bf635932691a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:10.382443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1103/2240] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:55:10.386454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c864a3d-27e7-44b2-8967-10a967e727f6 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:10.399130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c864a3d-27e7-44b2-8967-10a967e727f6 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:10.405152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:10.405767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.406381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.406670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] PATH_INFO: `/v3/projects/58dfc8682000482ba0e8be53757601d9/users/49858af59695497b9df8381ff1fb5add/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.410039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dfc8682000482ba0e8be53757601d9, user_id=49858af59695497b9df8381ff1fb5add, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:10.412984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:10.424899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1138/2241] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:10 2022] PUT /identity/v3/projects/58dfc8682000482ba0e8be53757601d9/users/49858af59695497b9df8381ff1fb5add/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:10.436327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780045-3007-4eee-a5c6-106dfe718e79 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.436640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780045-3007-4eee-a5c6-106dfe718e79 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.436959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780045-3007-4eee-a5c6-106dfe718e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.471861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-df780045-3007-4eee-a5c6-106dfe718e79 None None] MFA Rules not processed for user `49858af59695497b9df8381ff1fb5add`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:10.473449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-df780045-3007-4eee-a5c6-106dfe718e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:10.569617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1104/2242] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:10.577682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:10.580048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:10.686090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa157a-31e0-46bb-9592-797c29f93e71 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:10.690664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:10.691346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.691851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.692281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.727511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:10.729386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:10.747313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1139/2243] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:10.802678 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df780045-3007-4eee-a5c6-106dfe718e79 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:10.804227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-df780045-3007-4eee-a5c6-106dfe718e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:10.822119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df780045-3007-4eee-a5c6-106dfe718e79 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:10.828518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396abe5-4584-4275-8fb9-8f1074a5570a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:10.829567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396abe5-4584-4275-8fb9-8f1074a5570a service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:10.830447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396abe5-4584-4275-8fb9-8f1074a5570a service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:10.830723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396abe5-4584-4275-8fb9-8f1074a5570a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:10.893762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:10.942440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396abe5-4584-4275-8fb9-8f1074a5570a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:10.947018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396abe5-4584-4275-8fb9-8f1074a5570a service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:10.967536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1105/2244] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:11.806746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:11.808846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:11.847135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:11.923249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6623e-7151-46d0-9c00-a1152055a1c4 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:11.929302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:11.929975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:11.930260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:11.930537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] PATH_INFO: `/v3/users/7e2632fdee354f169d060f90eca1dfe3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:11.932517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2632fdee354f169d060f90eca1dfe3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:11.934492 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:12.003559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2632fdee354f169d060f90eca1dfe3'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:12.013941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2632fdee354f169d060f90eca1dfe3'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:12.031638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2632fdee354f169d060f90eca1dfe3'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:12.032401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2632fdee354f169d060f90eca1dfe3'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:12.049953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2632fdee354f169d060f90eca1dfe3'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:12.057211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1140/2245] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:55:11 2022] DELETE /identity/v3/users/7e2632fdee354f169d060f90eca1dfe3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:12.061859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a9bb-aeed-4b6a-92ee-6a3b4287a5bd None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:12.063160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a9bb-aeed-4b6a-92ee-6a3b4287a5bd None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:12.063597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a9bb-aeed-4b6a-92ee-6a3b4287a5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:12.086291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0872a9bb-aeed-4b6a-92ee-6a3b4287a5bd None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:12.087838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0872a9bb-aeed-4b6a-92ee-6a3b4287a5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:12.242401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1106/2246] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:12.256871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:12.258654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:12.370339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd337d19-e2ef-4f60-b3da-6db42e3a33e9 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:12.374523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308ccc9-1c62-450e-b625-46765ddbfcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:12.375281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308ccc9-1c62-450e-b625-46765ddbfcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:12.375564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308ccc9-1c62-450e-b625-46765ddbfcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:12.375841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308ccc9-1c62-450e-b625-46765ddbfcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:12.387293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308ccc9-1c62-450e-b625-46765ddbfcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:12.389068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308ccc9-1c62-450e-b625-46765ddbfcb6 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:12.402286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1141/2247] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:13.100623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872a9bb-aeed-4b6a-92ee-6a3b4287a5bd None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:13.102732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0872a9bb-aeed-4b6a-92ee-6a3b4287a5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:13.124401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872a9bb-aeed-4b6a-92ee-6a3b4287a5bd None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:13.137143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:13.138198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:13.138641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:13.139108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] PATH_INFO: `/v3/projects/1eeaa9a816f3498c9bff9d77a3cf29ea` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:13.147567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eeaa9a816f3498c9bff9d77a3cf29ea)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:13.149889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:13.257452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eeaa9a816f3498c9bff9d77a3cf29ea', 'request_id': 'req-f09de47e-f31c-452c-9d75-8db75d714426'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:13.279366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eeaa9a816f3498c9bff9d77a3cf29ea', 'request_id': 'req-f09de47e-f31c-452c-9d75-8db75d714426'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:13.300555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eeaa9a816f3498c9bff9d77a3cf29ea', 'request_id': 'req-f09de47e-f31c-452c-9d75-8db75d714426'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:13.318841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] The token cache is being invalidate because project 1eeaa9a816f3498c9bff9d77a3cf29ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:55:13.319164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:13.319911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:13.321450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1107/2248] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:55:13 2022] DELETE /identity/v3/projects/1eeaa9a816f3498c9bff9d77a3cf29ea => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:14.741848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6640db-7177-4498-a8a3-9d1f9c018e77 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:14.742704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6640db-7177-4498-a8a3-9d1f9c018e77 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:14.743195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6640db-7177-4498-a8a3-9d1f9c018e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:14.807974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8e6640db-7177-4498-a8a3-9d1f9c018e77 None None] MFA Rules not processed for user `3c58a61adbd74ae58da8dec020922451`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:14.809250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8e6640db-7177-4498-a8a3-9d1f9c018e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:14.902498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:14.936506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1142/2249] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:14.941646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:14.943608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:15.018581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09de47e-f31c-452c-9d75-8db75d714426 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:15.023995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dd73e-c66d-49f1-8ec3-757b67df3c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:15.025368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dd73e-c66d-49f1-8ec3-757b67df3c73 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.025814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dd73e-c66d-49f1-8ec3-757b67df3c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.026257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dd73e-c66d-49f1-8ec3-757b67df3c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.027145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dd73e-c66d-49f1-8ec3-757b67df3c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:15.029770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dd73e-c66d-49f1-8ec3-757b67df3c73 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:15.037476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:15.070628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1108/2250] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:55:14 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:15.074722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6640db-7177-4498-a8a3-9d1f9c018e77 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:15.086756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6640db-7177-4498-a8a3-9d1f9c018e77 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:15.163667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9b946-340e-442b-9cc0-0aaa70be841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:15.164366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9b946-340e-442b-9cc0-0aaa70be841a admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.164918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9b946-340e-442b-9cc0-0aaa70be841a admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.165230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9b946-340e-442b-9cc0-0aaa70be841a admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.166080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9b946-340e-442b-9cc0-0aaa70be841a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:15.168370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9b946-340e-442b-9cc0-0aaa70be841a admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:15.201078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1143/2251] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:55:15 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:15.206293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dd73e-c66d-49f1-8ec3-757b67df3c73 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:15.217742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dd73e-c66d-49f1-8ec3-757b67df3c73 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:15.225331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:15.225997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.226280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.226608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.227362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:15.228980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:15.244718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1109/2252] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:55:15.246183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9b946-340e-442b-9cc0-0aaa70be841a admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:15.254527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:15.258164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:15.267743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9b946-340e-442b-9cc0-0aaa70be841a admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:15.290598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39905af3-ef3a-4a67-bff0-df5de0ac66c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:15.291327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39905af3-ef3a-4a67-bff0-df5de0ac66c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.291614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39905af3-ef3a-4a67-bff0-df5de0ac66c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.291893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39905af3-ef3a-4a67-bff0-df5de0ac66c6 admin admin] PATH_INFO: `/v3/projects/9c87913a5c3f4ea6acc9fbdbc80aa4c1/users/a80324d896d04ec681d8b52100535fdc/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.299080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02605455-9b2e-424b-bc8c-5032ebe54720 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:15.304834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:15.305550 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.305842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.306127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] PATH_INFO: `/v3/users/8f25eed345ba4764b7340c92bf8e72bb` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.307414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f25eed345ba4764b7340c92bf8e72bb)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:15.309662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:15.310518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39905af3-ef3a-4a67-bff0-df5de0ac66c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c87913a5c3f4ea6acc9fbdbc80aa4c1, user_id=a80324d896d04ec681d8b52100535fdc, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:15.317736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39905af3-ef3a-4a67-bff0-df5de0ac66c6 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:15.339143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1144/2253] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:15 2022] PUT /identity/v3/projects/9c87913a5c3f4ea6acc9fbdbc80aa4c1/users/a80324d896d04ec681d8b52100535fdc/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:15.342694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39905af3-ef3a-4a67-bff0-df5de0ac66c6 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:15.383209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f25eed345ba4764b7340c92bf8e72bb'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:15.392623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f25eed345ba4764b7340c92bf8e72bb'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:15.398449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f25eed345ba4764b7340c92bf8e72bb'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:15.418361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f25eed345ba4764b7340c92bf8e72bb'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:15.419235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-920c725c-7aed-4a76-8d85-0888a6fafc7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f25eed345ba4764b7340c92bf8e72bb'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:15.422798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39905af3-ef3a-4a67-bff0-df5de0ac66c6 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:15.429449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:15.430201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.430413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.430713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.431514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:15.437651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:15.438858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1110/2254] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:55:15 2022] DELETE /identity/v3/users/8f25eed345ba4764b7340c92bf8e72bb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:15.443044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b79e5-66d2-44f8-b436-9d207998a165 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.443437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b79e5-66d2-44f8-b436-9d207998a165 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.443784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b79e5-66d2-44f8-b436-9d207998a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.449438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1145/2255] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:55:15.453484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:15.455499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:15.468280 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-fc6b79e5-66d2-44f8-b436-9d207998a165 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:15.469558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-fc6b79e5-66d2-44f8-b436-9d207998a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:15.470855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536dd96-5f1e-4745-9f8f-39368b3a2c76 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:15.517572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:15.537951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:15.538557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.539063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1111/2256] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:55:15.541908 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.542514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] PATH_INFO: `/v3/projects/9c87913a5c3f4ea6acc9fbdbc80aa4c1/users/a80324d896d04ec681d8b52100535fdc/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.544392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c87913a5c3f4ea6acc9fbdbc80aa4c1, user_id=a80324d896d04ec681d8b52100535fdc, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:15.547507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:15.549164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b79e5-66d2-44f8-b436-9d207998a165 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:15.550800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-fc6b79e5-66d2-44f8-b436-9d207998a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:15.560275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1146/2257] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:15 2022] PUT /identity/v3/projects/9c87913a5c3f4ea6acc9fbdbc80aa4c1/users/a80324d896d04ec681d8b52100535fdc/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 07:55:15.614783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:15.619412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b79e5-66d2-44f8-b436-9d207998a165 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:15.687133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19696e-9117-4809-bf50-94a27202bee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:15.687917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19696e-9117-4809-bf50-94a27202bee4 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:15.688197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19696e-9117-4809-bf50-94a27202bee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:15.688474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19696e-9117-4809-bf50-94a27202bee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:15.765873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19696e-9117-4809-bf50-94a27202bee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:15.767888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19696e-9117-4809-bf50-94a27202bee4 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:15.778749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1112/2258] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:55:16.104966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:16.107339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:16.125452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2034-b09e-467a-91f9-611e48b0a616 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:16.130810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:16.131504 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:16.131789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:16.132202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] PATH_INFO: `/v3/projects/9f76b67ad40540b0b71675f911aec26d` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:16.133424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f76b67ad40540b0b71675f911aec26d)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:16.135385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:16.206980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f76b67ad40540b0b71675f911aec26d', 'request_id': 'req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.224540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f76b67ad40540b0b71675f911aec26d', 'request_id': 'req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.240532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f76b67ad40540b0b71675f911aec26d', 'request_id': 'req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.257640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] The token cache is being invalidate because project 9f76b67ad40540b0b71675f911aec26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:55:16.257934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.258596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.260479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1147/2259] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:55:16 2022] DELETE /identity/v3/projects/9f76b67ad40540b0b71675f911aec26d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:16.265478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19696e-9117-4809-bf50-94a27202bee4 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:16.283624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19696e-9117-4809-bf50-94a27202bee4 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:16.360968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:16.361986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:16.362337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:16.363166 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] PATH_INFO: `/v3/users/49858af59695497b9df8381ff1fb5add` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:16.364653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49858af59695497b9df8381ff1fb5add)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:16.368517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:16.434148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49858af59695497b9df8381ff1fb5add'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.441694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49858af59695497b9df8381ff1fb5add'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.442388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49858af59695497b9df8381ff1fb5add'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.443986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:16.469358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49858af59695497b9df8381ff1fb5add'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.470759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-79574587-e74b-45e4-b2e8-0f239a95a950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49858af59695497b9df8381ff1fb5add'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:16.510917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1113/2260] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:55:16 2022] DELETE /identity/v3/users/49858af59695497b9df8381ff1fb5add => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:16.845425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:16.846865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:16.866060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19115a2-f8c7-40d9-b6dd-bde2ce281d42 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:16.944232 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:16.945299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:16.945652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:16.946022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] PATH_INFO: `/v3/projects/58dfc8682000482ba0e8be53757601d9` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:16.947394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58dfc8682000482ba0e8be53757601d9)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:16.951248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:17.022209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58dfc8682000482ba0e8be53757601d9', 'request_id': 'req-d9958b9c-af24-40fd-9f7d-636832bdba02'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:17.031476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58dfc8682000482ba0e8be53757601d9', 'request_id': 'req-d9958b9c-af24-40fd-9f7d-636832bdba02'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:17.036234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:17.040970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58dfc8682000482ba0e8be53757601d9', 'request_id': 'req-d9958b9c-af24-40fd-9f7d-636832bdba02'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:17.060747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] The token cache is being invalidate because project 58dfc8682000482ba0e8be53757601d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:55:17.060747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:17.060747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d9958b9c-af24-40fd-9f7d-636832bdba02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:17.061582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1148/2261] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:55:16 2022] DELETE /identity/v3/projects/58dfc8682000482ba0e8be53757601d9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:17.067940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60585c8-1a4e-41cd-a927-c45f07ddfca3 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.068506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60585c8-1a4e-41cd-a927-c45f07ddfca3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.068800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60585c8-1a4e-41cd-a927-c45f07ddfca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.093599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e60585c8-1a4e-41cd-a927-c45f07ddfca3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:17.094986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e60585c8-1a4e-41cd-a927-c45f07ddfca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:17.176413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1114/2262] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:17.184072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f971-9b32-4ce7-b7e0-68689c728068 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.185105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f971-9b32-4ce7-b7e0-68689c728068 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.185438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055f971-9b32-4ce7-b7e0-68689c728068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.210065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c055f971-9b32-4ce7-b7e0-68689c728068 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:17.211541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c055f971-9b32-4ce7-b7e0-68689c728068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:17.228754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1149/2263] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:17.233303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60585c8-1a4e-41cd-a927-c45f07ddfca3 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:17.259565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60585c8-1a4e-41cd-a927-c45f07ddfca3 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:17.271064 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:17.272421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.272918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.273429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.274785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:55:17.275610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:17.277640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:17.295798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1115/2264] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:55:17.300643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055f971-9b32-4ce7-b7e0-68689c728068 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:17.313693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055f971-9b32-4ce7-b7e0-68689c728068 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:17.329928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba709c-90ed-454f-af4f-43a127bd58d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:17.330770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba709c-90ed-454f-af4f-43a127bd58d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.331100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba709c-90ed-454f-af4f-43a127bd58d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.331368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba709c-90ed-454f-af4f-43a127bd58d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.332053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba709c-90ed-454f-af4f-43a127bd58d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:17.334010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba709c-90ed-454f-af4f-43a127bd58d8 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:17.375413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1150/2265] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:55:17 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:17.377485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:17.396665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314dfa1-0dbc-4fbf-b88b-157cd4b573c7 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:17.495117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006951c-82a6-40ec-a4df-33e2fd0adf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:17.495750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006951c-82a6-40ec-a4df-33e2fd0adf64 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.496040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006951c-82a6-40ec-a4df-33e2fd0adf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.496320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006951c-82a6-40ec-a4df-33e2fd0adf64 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.496998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006951c-82a6-40ec-a4df-33e2fd0adf64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:17.498987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006951c-82a6-40ec-a4df-33e2fd0adf64 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:17.549371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1116/2266] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:55:17 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:17.550629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba709c-90ed-454f-af4f-43a127bd58d8 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:17.563506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba709c-90ed-454f-af4f-43a127bd58d8 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:17.568662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb72839-6e1c-451f-8d3a-8f5c4800b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:17.569282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72839-6e1c-451f-8d3a-8f5c4800b609 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.569691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72839-6e1c-451f-8d3a-8f5c4800b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.570126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb72839-6e1c-451f-8d3a-8f5c4800b609 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.570844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb72839-6e1c-451f-8d3a-8f5c4800b609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:17.572576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb72839-6e1c-451f-8d3a-8f5c4800b609 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:17.587129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1151/2267] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:55:17.596717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006951c-82a6-40ec-a4df-33e2fd0adf64 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:17.609949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006951c-82a6-40ec-a4df-33e2fd0adf64 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:17.615594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df6ab8-0f3a-4cf8-a61c-ce3a30eb13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:17.616230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ab8-0f3a-4cf8-a61c-ce3a30eb13e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.616516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ab8-0f3a-4cf8-a61c-ce3a30eb13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.616800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ab8-0f3a-4cf8-a61c-ce3a30eb13e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.617543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df6ab8-0f3a-4cf8-a61c-ce3a30eb13e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:17.619221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df6ab8-0f3a-4cf8-a61c-ce3a30eb13e1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:17.633101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1117/2268] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:55:17.637688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb72839-6e1c-451f-8d3a-8f5c4800b609 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:17.656647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb72839-6e1c-451f-8d3a-8f5c4800b609 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:17.663948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127bf03-fc23-49f7-942c-edc3aa1da433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:17.665156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bf03-fc23-49f7-942c-edc3aa1da433 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.665364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bf03-fc23-49f7-942c-edc3aa1da433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.666279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bf03-fc23-49f7-942c-edc3aa1da433 admin admin] PATH_INFO: `/v3/projects/ffe981a04e69428281c809d97b9ec36a/users/ea74952375ad4048b949fb24d93dae95/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.683595 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127bf03-fc23-49f7-942c-edc3aa1da433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe981a04e69428281c809d97b9ec36a, user_id=ea74952375ad4048b949fb24d93dae95, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:17.686572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127bf03-fc23-49f7-942c-edc3aa1da433 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:17.707788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1152/2269] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:17 2022] PUT /identity/v3/projects/ffe981a04e69428281c809d97b9ec36a/users/ea74952375ad4048b949fb24d93dae95/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:17.718157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fa1be-bdf4-4e64-a706-3f360b5d2fd8 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.718509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fa1be-bdf4-4e64-a706-3f360b5d2fd8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.718734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fa1be-bdf4-4e64-a706-3f360b5d2fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.748511 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-fa0fa1be-bdf4-4e64-a706-3f360b5d2fd8 None None] MFA Rules not processed for user `ea74952375ad4048b949fb24d93dae95`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:17.749732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-fa0fa1be-bdf4-4e64-a706-3f360b5d2fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:17.782232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:17.830820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1118/2270] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:17.836644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127bf03-fc23-49f7-942c-edc3aa1da433 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:17.928172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127bf03-fc23-49f7-942c-edc3aa1da433 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:17.936404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94ab0-1d17-48e9-9ccd-43fd4eed663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:17.937054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94ab0-1d17-48e9-9ccd-43fd4eed663d admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:17.937367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94ab0-1d17-48e9-9ccd-43fd4eed663d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:17.937636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94ab0-1d17-48e9-9ccd-43fd4eed663d admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:17.938314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac94ab0-1d17-48e9-9ccd-43fd4eed663d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:17.940839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac94ab0-1d17-48e9-9ccd-43fd4eed663d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:17.973010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1153/2271] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:55:17 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:17.976813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fa1be-bdf4-4e64-a706-3f360b5d2fd8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:17.994114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fa1be-bdf4-4e64-a706-3f360b5d2fd8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:18.109225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde3fc-86ba-4d53-aa21-063a62b46ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:18.109886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde3fc-86ba-4d53-aa21-063a62b46ada admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:18.110175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde3fc-86ba-4d53-aa21-063a62b46ada admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:18.110461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dde3fc-86ba-4d53-aa21-063a62b46ada admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:18.111729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dde3fc-86ba-4d53-aa21-063a62b46ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:18.113687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dde3fc-86ba-4d53-aa21-063a62b46ada admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:18.155248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94ab0-1d17-48e9-9ccd-43fd4eed663d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:18.168893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94ab0-1d17-48e9-9ccd-43fd4eed663d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:18.174403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1119/2272] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:55:17 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:55:18.194553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fa35c-f775-4cd4-8c00-88d405386acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:18.195231 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa35c-f775-4cd4-8c00-88d405386acb admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:18.195521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa35c-f775-4cd4-8c00-88d405386acb admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:18.195799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa35c-f775-4cd4-8c00-88d405386acb admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:18.196723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fa35c-f775-4cd4-8c00-88d405386acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:18.198555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fa35c-f775-4cd4-8c00-88d405386acb admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:18.230506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde3fc-86ba-4d53-aa21-063a62b46ada admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:18.231050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1154/2273] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:55:18.257951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dde3fc-86ba-4d53-aa21-063a62b46ada admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:18.274360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952a77-a0c8-4fef-8334-c713e8e8dee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:18.278135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952a77-a0c8-4fef-8334-c713e8e8dee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:18.279587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952a77-a0c8-4fef-8334-c713e8e8dee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:18.280122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952a77-a0c8-4fef-8334-c713e8e8dee9 admin admin] PATH_INFO: `/v3/projects/8f6c20e8f6ed4f99bb5d144b5af95228/users/e0ea394c599e4bee8833cc483767caf2/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:18.314261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952a77-a0c8-4fef-8334-c713e8e8dee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6c20e8f6ed4f99bb5d144b5af95228, user_id=e0ea394c599e4bee8833cc483767caf2, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:18.318035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952a77-a0c8-4fef-8334-c713e8e8dee9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:18.342335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1120/2274] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:18 2022] PUT /identity/v3/projects/8f6c20e8f6ed4f99bb5d144b5af95228/users/e0ea394c599e4bee8833cc483767caf2/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:18.347588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fa35c-f775-4cd4-8c00-88d405386acb admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:18.359647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fa35c-f775-4cd4-8c00-88d405386acb admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:18.466885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6b234-cf43-4136-b8e2-3a6e8ae9309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:18.467835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b234-cf43-4136-b8e2-3a6e8ae9309d admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:18.468336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b234-cf43-4136-b8e2-3a6e8ae9309d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:18.468852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b234-cf43-4136-b8e2-3a6e8ae9309d admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:18.469793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6b234-cf43-4136-b8e2-3a6e8ae9309d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:18.472443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6b234-cf43-4136-b8e2-3a6e8ae9309d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:18.474306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:18.493970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1155/2275] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:55:18.494188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952a77-a0c8-4fef-8334-c713e8e8dee9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:18.512105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952a77-a0c8-4fef-8334-c713e8e8dee9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:18.517997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:18.518911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:18.519312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:18.519833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] PATH_INFO: `/v3/projects/8f6c20e8f6ed4f99bb5d144b5af95228/users/e0ea394c599e4bee8833cc483767caf2/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:18.523401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6c20e8f6ed4f99bb5d144b5af95228, user_id=e0ea394c599e4bee8833cc483767caf2, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:18.526348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:18.553152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1121/2276] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:18 2022] PUT /identity/v3/projects/8f6c20e8f6ed4f99bb5d144b5af95228/users/e0ea394c599e4bee8833cc483767caf2/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:18.564630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f234-1e3e-4671-b1fe-d56c8d1f56b2 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:18.565045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f234-1e3e-4671-b1fe-d56c8d1f56b2 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:18.565339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f234-1e3e-4671-b1fe-d56c8d1f56b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:18.632684 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-eaa1f234-1e3e-4671-b1fe-d56c8d1f56b2 None None] MFA Rules not processed for user `e0ea394c599e4bee8833cc483767caf2`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:18.634788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-eaa1f234-1e3e-4671-b1fe-d56c8d1f56b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:18.759309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1156/2277] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:18.772846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:18.775269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:18.876299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1eb8b-01e1-46ee-ab11-ac7638edd29f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:18.881146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fde780-cf7a-4c05-bafc-aa7ee492e18c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:18.882404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde780-cf7a-4c05-bafc-aa7ee492e18c service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:18.882689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde780-cf7a-4c05-bafc-aa7ee492e18c service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:18.882990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde780-cf7a-4c05-bafc-aa7ee492e18c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:18.896867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fde780-cf7a-4c05-bafc-aa7ee492e18c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:18.903195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fde780-cf7a-4c05-bafc-aa7ee492e18c service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:18.916245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1122/2278] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:55:19.039053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1f234-1e3e-4671-b1fe-d56c8d1f56b2 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:19.054643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1f234-1e3e-4671-b1fe-d56c8d1f56b2 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:19.061560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:19.063308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:19.064630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:19.068456 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:19.155820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:19.157820 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:19.171900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1157/2279] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:20.443281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af202a4-51f1-4dac-a7ea-ad44d4a9a3a6 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:20.443736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af202a4-51f1-4dac-a7ea-ad44d4a9a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:20.443828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af202a4-51f1-4dac-a7ea-ad44d4a9a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:20.472386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0af202a4-51f1-4dac-a7ea-ad44d4a9a3a6 None None] MFA Rules not processed for user `a80324d896d04ec681d8b52100535fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:20.473524 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0af202a4-51f1-4dac-a7ea-ad44d4a9a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:20.485027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:20.544809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1123/2280] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:20.559632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:20.561155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:20.642514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbbfae-9d2a-4781-b0a8-886e8e2f591f service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:20.651240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde413e5-d747-47f6-8304-f70a499ace13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:20.653393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde413e5-d747-47f6-8304-f70a499ace13 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:20.653681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde413e5-d747-47f6-8304-f70a499ace13 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:20.653957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde413e5-d747-47f6-8304-f70a499ace13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:20.656320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cde413e5-d747-47f6-8304-f70a499ace13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:20.670610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:20.723547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde413e5-d747-47f6-8304-f70a499ace13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:20.727629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde413e5-d747-47f6-8304-f70a499ace13 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:20.738220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1158/2281] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:22.106871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af202a4-51f1-4dac-a7ea-ad44d4a9a3a6 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:22.215376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af202a4-51f1-4dac-a7ea-ad44d4a9a3a6 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:22.220974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:22.221775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:22.222068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:22.222351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] PATH_INFO: `/v3/users/ea74952375ad4048b949fb24d93dae95` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:22.223745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea74952375ad4048b949fb24d93dae95)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:22.226094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:22.323621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea74952375ad4048b949fb24d93dae95'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:22.344674 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea74952375ad4048b949fb24d93dae95'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:22.344674 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea74952375ad4048b949fb24d93dae95'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:22.363358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea74952375ad4048b949fb24d93dae95'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:22.364259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea74952375ad4048b949fb24d93dae95'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:22.404530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1124/2282] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:55:22 2022] DELETE /identity/v3/users/ea74952375ad4048b949fb24d93dae95 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:22.409684 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3888a0-3f7f-46e6-acbf-6177169e96e6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:22.410226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3888a0-3f7f-46e6-acbf-6177169e96e6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:22.410226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3888a0-3f7f-46e6-acbf-6177169e96e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:22.431434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-cd3888a0-3f7f-46e6-acbf-6177169e96e6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:22.433166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cd3888a0-3f7f-46e6-acbf-6177169e96e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:22.524460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1159/2283] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:22.537195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:22.538750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:22.578893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:22.623107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83658c8b-fcfc-41ab-8d64-38ae4f7098c2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:22.628866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3930bb-1542-4d35-9f32-0cc62ff69302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:22.629819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3930bb-1542-4d35-9f32-0cc62ff69302 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:22.630158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3930bb-1542-4d35-9f32-0cc62ff69302 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:22.630424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3930bb-1542-4d35-9f32-0cc62ff69302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:22.643078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3930bb-1542-4d35-9f32-0cc62ff69302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:22.645367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3930bb-1542-4d35-9f32-0cc62ff69302 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:22.658471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1125/2284] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:23.031189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3888a0-3f7f-46e6-acbf-6177169e96e6 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:23.032683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cd3888a0-3f7f-46e6-acbf-6177169e96e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:23.046977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3888a0-3f7f-46e6-acbf-6177169e96e6 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:23.053545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:23.054381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:23.054848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:23.055182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] PATH_INFO: `/v3/projects/ffe981a04e69428281c809d97b9ec36a` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:23.056665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe981a04e69428281c809d97b9ec36a)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:23.058361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:23.111535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe981a04e69428281c809d97b9ec36a', 'request_id': 'req-61e8317b-3d09-4ad9-9c77-b3a801adcda2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.119748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe981a04e69428281c809d97b9ec36a', 'request_id': 'req-61e8317b-3d09-4ad9-9c77-b3a801adcda2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.127451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe981a04e69428281c809d97b9ec36a', 'request_id': 'req-61e8317b-3d09-4ad9-9c77-b3a801adcda2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.144015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] The token cache is being invalidate because project ffe981a04e69428281c809d97b9ec36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:55:23.144312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.144999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.147036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1160/2285] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:55:23 2022] DELETE /identity/v3/projects/ffe981a04e69428281c809d97b9ec36a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:23.150587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3930bb-1542-4d35-9f32-0cc62ff69302 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:23.165971 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3930bb-1542-4d35-9f32-0cc62ff69302 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:23.230282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:23.231171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:23.231462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:23.231753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] PATH_INFO: `/v3/users/e0ea394c599e4bee8833cc483767caf2` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:23.232961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ea394c599e4bee8833cc483767caf2)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:23.234893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:23.293924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ea394c599e4bee8833cc483767caf2'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.302727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ea394c599e4bee8833cc483767caf2'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.303506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ea394c599e4bee8833cc483767caf2'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.318922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ea394c599e4bee8833cc483767caf2'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.319684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3dc0a88f-1f51-4cfa-b473-cf4d0d7e4d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ea394c599e4bee8833cc483767caf2'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.335563 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1126/2286] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:55:23 2022] DELETE /identity/v3/users/e0ea394c599e4bee8833cc483767caf2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:23.632678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:23.634209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:23.649219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8317b-3d09-4ad9-9c77-b3a801adcda2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:23.693670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:23.715851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:23.716636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:23.716998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:23.717422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] PATH_INFO: `/v3/projects/8f6c20e8f6ed4f99bb5d144b5af95228` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:23.718871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6c20e8f6ed4f99bb5d144b5af95228)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:23.721569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:23.777849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6c20e8f6ed4f99bb5d144b5af95228', 'request_id': 'req-d56d288d-ea0f-44a3-9f19-3a806a8628cf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.788469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6c20e8f6ed4f99bb5d144b5af95228', 'request_id': 'req-d56d288d-ea0f-44a3-9f19-3a806a8628cf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.795644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6c20e8f6ed4f99bb5d144b5af95228', 'request_id': 'req-d56d288d-ea0f-44a3-9f19-3a806a8628cf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.808074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] The token cache is being invalidate because project 8f6c20e8f6ed4f99bb5d144b5af95228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:55:23.808371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.809168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d56d288d-ea0f-44a3-9f19-3a806a8628cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:55:23.811013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1161/2287] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:55:23 2022] DELETE /identity/v3/projects/8f6c20e8f6ed4f99bb5d144b5af95228 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:23.815564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474e30-c745-4f4c-88d1-d15507cf4bd7 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:23.815863 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474e30-c745-4f4c-88d1-d15507cf4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:23.816155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a474e30-c745-4f4c-88d1-d15507cf4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:23.836670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9a474e30-c745-4f4c-88d1-d15507cf4bd7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:23.837976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9a474e30-c745-4f4c-88d1-d15507cf4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:23.887127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:23.911192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1127/2288] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:23.919420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db7ba-6e78-4afb-b84d-41b2b1a9475d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:23.919709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db7ba-6e78-4afb-b84d-41b2b1a9475d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:23.920033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db7ba-6e78-4afb-b84d-41b2b1a9475d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:23.941247 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3d1db7ba-6e78-4afb-b84d-41b2b1a9475d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:23.942909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3d1db7ba-6e78-4afb-b84d-41b2b1a9475d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:23.952155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1162/2289] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:23.957102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a474e30-c745-4f4c-88d1-d15507cf4bd7 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:23.967900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a474e30-c745-4f4c-88d1-d15507cf4bd7 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:23.973250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:23.973875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:23.974154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:23.975167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:23.975167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:55:23.975447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:23.977127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:23.989665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1128/2290] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:55:23.993957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db7ba-6e78-4afb-b84d-41b2b1a9475d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:24.003299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db7ba-6e78-4afb-b84d-41b2b1a9475d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:24.008424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592af55-ef0a-4707-bd9f-f43c8fc988c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:24.009328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592af55-ef0a-4707-bd9f-f43c8fc988c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:24.009776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592af55-ef0a-4707-bd9f-f43c8fc988c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:24.010205 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592af55-ef0a-4707-bd9f-f43c8fc988c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:24.011097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592af55-ef0a-4707-bd9f-f43c8fc988c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:24.013475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592af55-ef0a-4707-bd9f-f43c8fc988c3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:24.045407 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1163/2291] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:55:23 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:55:24.049555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:24.059703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5af71-bb9a-49e4-b93f-fc06134e9937 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:24.123053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662de71-c31f-46a8-8713-8d936a913ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:24.123681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662de71-c31f-46a8-8713-8d936a913ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:24.123969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662de71-c31f-46a8-8713-8d936a913ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:24.124250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662de71-c31f-46a8-8713-8d936a913ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:24.124946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662de71-c31f-46a8-8713-8d936a913ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:24.126913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662de71-c31f-46a8-8713-8d936a913ab4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:24.151990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1129/2292] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:55:24 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:55:24.155914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592af55-ef0a-4707-bd9f-f43c8fc988c3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:24.179109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592af55-ef0a-4707-bd9f-f43c8fc988c3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:24.184842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a55171-9790-4e68-83fb-b0e90c66690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:24.185497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55171-9790-4e68-83fb-b0e90c66690e admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:24.185728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55171-9790-4e68-83fb-b0e90c66690e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:24.185999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55171-9790-4e68-83fb-b0e90c66690e admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:24.186694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a55171-9790-4e68-83fb-b0e90c66690e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:24.188320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a55171-9790-4e68-83fb-b0e90c66690e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:24.200074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1164/2293] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:55:24.203773 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662de71-c31f-46a8-8713-8d936a913ab4 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:24.217406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662de71-c31f-46a8-8713-8d936a913ab4 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:24.222672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f7071-35ee-400b-880a-ceb79f69d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:24.223405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7071-35ee-400b-880a-ceb79f69d1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:24.223691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7071-35ee-400b-880a-ceb79f69d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:24.223968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7071-35ee-400b-880a-ceb79f69d1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:24.224726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f7071-35ee-400b-880a-ceb79f69d1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:24.226598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f7071-35ee-400b-880a-ceb79f69d1c7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:24.239833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1130/2294] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:55:24.243983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a55171-9790-4e68-83fb-b0e90c66690e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:24.257819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a55171-9790-4e68-83fb-b0e90c66690e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:24.262834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:24.266553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:24.266553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:24.266553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] PATH_INFO: `/v3/projects/fb42a1f832e24bd5b8725ea878804e9d/users/fe34ac120d344b608722a430d2032d1f/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:24.284961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb42a1f832e24bd5b8725ea878804e9d, user_id=fe34ac120d344b608722a430d2032d1f, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:24.287655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:24.310194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1165/2295] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:55:24 2022] PUT /identity/v3/projects/fb42a1f832e24bd5b8725ea878804e9d/users/fe34ac120d344b608722a430d2032d1f/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:55:24.322074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7abe5-0a6c-491c-aa1d-4dac6ad38321 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:24.322365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7abe5-0a6c-491c-aa1d-4dac6ad38321 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:24.322667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7abe5-0a6c-491c-aa1d-4dac6ad38321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:24.369930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-c2b7abe5-0a6c-491c-aa1d-4dac6ad38321 None None] MFA Rules not processed for user `fe34ac120d344b608722a430d2032d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:24.372254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c2b7abe5-0a6c-491c-aa1d-4dac6ad38321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:24.466053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1131/2296] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:55:24.477153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:55:24.478986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:24.559341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c457e-f56e-49e2-91c5-2576439d6d72 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:55:24.563599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f9e0-bc7a-4233-a99d-f5fe1d162454 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde6248cf0794fab88a093097b597c9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:55:24.565524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f9e0-bc7a-4233-a99d-f5fe1d162454 service glance] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:24.565960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f9e0-bc7a-4233-a99d-f5fe1d162454 service glance] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:24.566730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f9e0-bc7a-4233-a99d-f5fe1d162454 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:24.583279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2f9e0-bc7a-4233-a99d-f5fe1d162454 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:55:24.583757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2f9e0-bc7a-4233-a99d-f5fe1d162454 service glance] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:55:24.598011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1166/2297] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:55:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:55:34.459070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:34.589267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:55:59.474038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adebff5-301a-486d-999f-e84fddc1c70f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:55:59.474553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adebff5-301a-486d-999f-e84fddc1c70f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:55:59.474649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adebff5-301a-486d-999f-e84fddc1c70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:55:59.493031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5adebff5-301a-486d-999f-e84fddc1c70f None None] MFA Rules not processed for user `3c58a61adbd74ae58da8dec020922451`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:55:59.494222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5adebff5-301a-486d-999f-e84fddc1c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:55:59.560698 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1132/2298] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:55:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:03.394859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f9e0-bc7a-4233-a99d-f5fe1d162454 service glance] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:03.460672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f9e0-bc7a-4233-a99d-f5fe1d162454 service glance] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:03.465952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:03.466603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:03.466888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:03.467203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] PATH_INFO: `/v3/users/fe34ac120d344b608722a430d2032d1f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:03.468389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe34ac120d344b608722a430d2032d1f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:03.470319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:03.524697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe34ac120d344b608722a430d2032d1f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:03.534788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe34ac120d344b608722a430d2032d1f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:03.545357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe34ac120d344b608722a430d2032d1f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:03.546199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe34ac120d344b608722a430d2032d1f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:03.562141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe34ac120d344b608722a430d2032d1f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:03.572114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1167/2299] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:56:03 2022] DELETE /identity/v3/users/fe34ac120d344b608722a430d2032d1f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:56:03.577349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a964-1e9a-483a-b399-2c4b879da235 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:03.577865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a964-1e9a-483a-b399-2c4b879da235 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:03.577966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a964-1e9a-483a-b399-2c4b879da235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:03.599880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ff05a964-1e9a-483a-b399-2c4b879da235 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:03.601642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ff05a964-1e9a-483a-b399-2c4b879da235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:03.678739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1133/2300] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:03.689755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:03.691378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:03.793286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38058-c87a-4e54-af27-393fe2645078 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:03.800013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd34877-456f-4297-84a0-2ba3f7461b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:03.800924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34877-456f-4297-84a0-2ba3f7461b95 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:03.801359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34877-456f-4297-84a0-2ba3f7461b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:03.801796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd34877-456f-4297-84a0-2ba3f7461b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:03.812912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd34877-456f-4297-84a0-2ba3f7461b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:03.814383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd34877-456f-4297-84a0-2ba3f7461b95 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:03.825558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1168/2301] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:04.200569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a964-1e9a-483a-b399-2c4b879da235 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:04.202473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ff05a964-1e9a-483a-b399-2c4b879da235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:04.221748 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a964-1e9a-483a-b399-2c4b879da235 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:04.229270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:04.230158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.230549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.230960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] PATH_INFO: `/v3/projects/fb42a1f832e24bd5b8725ea878804e9d` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.233857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb42a1f832e24bd5b8725ea878804e9d)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:04.236036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:04.300087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb42a1f832e24bd5b8725ea878804e9d', 'request_id': 'req-f4869f69-139e-4172-ba4a-e149791f28be'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:04.308264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb42a1f832e24bd5b8725ea878804e9d', 'request_id': 'req-f4869f69-139e-4172-ba4a-e149791f28be'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:04.318623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb42a1f832e24bd5b8725ea878804e9d', 'request_id': 'req-f4869f69-139e-4172-ba4a-e149791f28be'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:04.333569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] The token cache is being invalidate because project fb42a1f832e24bd5b8725ea878804e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:56:04.333873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:04.334556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f4869f69-139e-4172-ba4a-e149791f28be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:04.336261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1134/2302] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:56:04 2022] DELETE /identity/v3/projects/fb42a1f832e24bd5b8725ea878804e9d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:56:04.341391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f893960-a341-46ee-91bf-4f5b69bc5f54 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.341689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f893960-a341-46ee-91bf-4f5b69bc5f54 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.341976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f893960-a341-46ee-91bf-4f5b69bc5f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.371550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5f893960-a341-46ee-91bf-4f5b69bc5f54 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:04.372894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5f893960-a341-46ee-91bf-4f5b69bc5f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:04.393942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:04.439183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1169/2303] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:04.447670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33a01-2339-4e21-beca-75cbea3032cf None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.448016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33a01-2339-4e21-beca-75cbea3032cf None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.448307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a33a01-2339-4e21-beca-75cbea3032cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.467528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-18a33a01-2339-4e21-beca-75cbea3032cf None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:04.468670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-18a33a01-2339-4e21-beca-75cbea3032cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:04.476485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1135/2304] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:04.480523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f893960-a341-46ee-91bf-4f5b69bc5f54 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:04.490629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f893960-a341-46ee-91bf-4f5b69bc5f54 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:04.495308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:04.495919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.496206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.496486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.497221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:56:04.497533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:04.499156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:04.511623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1170/2305] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:56:04.515732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33a01-2339-4e21-beca-75cbea3032cf None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:04.524885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a33a01-2339-4e21-beca-75cbea3032cf None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:04.529590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5ea83-cc81-4ab8-800c-df6c8a228cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:04.530196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5ea83-cc81-4ab8-800c-df6c8a228cff admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.530478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5ea83-cc81-4ab8-800c-df6c8a228cff admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.530753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5ea83-cc81-4ab8-800c-df6c8a228cff admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.531472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5ea83-cc81-4ab8-800c-df6c8a228cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:04.533361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5ea83-cc81-4ab8-800c-df6c8a228cff admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:04.554909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:04.562459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1136/2306] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:56:04 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:56:04.567267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:04.577683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e09a0-e36d-4cf6-84aa-07d8c5d8f7c8 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:04.633173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93b246-e123-4846-a233-11b9015684aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:04.633780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93b246-e123-4846-a233-11b9015684aa admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.634064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93b246-e123-4846-a233-11b9015684aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.634342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93b246-e123-4846-a233-11b9015684aa admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.635044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93b246-e123-4846-a233-11b9015684aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:04.637245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93b246-e123-4846-a233-11b9015684aa admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:04.657935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1171/2307] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:56:04 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:56:04.662111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5ea83-cc81-4ab8-800c-df6c8a228cff admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:04.672208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5ea83-cc81-4ab8-800c-df6c8a228cff admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:04.676717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f83d9-fde8-48e0-83f1-7597d8c0795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:04.677316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f83d9-fde8-48e0-83f1-7597d8c0795c admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.677599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f83d9-fde8-48e0-83f1-7597d8c0795c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.677874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f83d9-fde8-48e0-83f1-7597d8c0795c admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.678564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f83d9-fde8-48e0-83f1-7597d8c0795c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:04.680213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f83d9-fde8-48e0-83f1-7597d8c0795c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:04.689947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1137/2308] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:56:04.694224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93b246-e123-4846-a233-11b9015684aa admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:04.704043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93b246-e123-4846-a233-11b9015684aa admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:04.709213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a7dd7-0c06-477b-856f-32af4a119738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:04.709810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7dd7-0c06-477b-856f-32af4a119738 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.710096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7dd7-0c06-477b-856f-32af4a119738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.710378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a7dd7-0c06-477b-856f-32af4a119738 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.711105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a7dd7-0c06-477b-856f-32af4a119738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:04.712685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a7dd7-0c06-477b-856f-32af4a119738 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:04.723150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1172/2309] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:56:04.726991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f83d9-fde8-48e0-83f1-7597d8c0795c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:04.736819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f83d9-fde8-48e0-83f1-7597d8c0795c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:04.741570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:04.742250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.742534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.742810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] PATH_INFO: `/v3/projects/750811fe2dc7415ca78d7d470081b552/users/95e2d3743d8a4adea8884143da87a322/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.757497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750811fe2dc7415ca78d7d470081b552, user_id=95e2d3743d8a4adea8884143da87a322, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:04.760154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:04.774626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1138/2310] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:56:04 2022] PUT /identity/v3/projects/750811fe2dc7415ca78d7d470081b552/users/95e2d3743d8a4adea8884143da87a322/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:56:04.784691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32bf2-abe9-4ef1-91fd-a3bd60358546 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.784979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32bf2-abe9-4ef1-91fd-a3bd60358546 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.785257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32bf2-abe9-4ef1-91fd-a3bd60358546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.812014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-07a32bf2-abe9-4ef1-91fd-a3bd60358546 None None] MFA Rules not processed for user `95e2d3743d8a4adea8884143da87a322`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:04.813226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-07a32bf2-abe9-4ef1-91fd-a3bd60358546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:04.877134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1173/2311] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:04.888785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:04.890481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:04.955056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd8d95-3038-4e93-a3b6-4a49b1b03066 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:04.959316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898fb73-cc6f-4ac9-b9c5-db4f2f55c28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:04.959927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898fb73-cc6f-4ac9-b9c5-db4f2f55c28f service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:04.960211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898fb73-cc6f-4ac9-b9c5-db4f2f55c28f service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:04.960488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898fb73-cc6f-4ac9-b9c5-db4f2f55c28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:04.968640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898fb73-cc6f-4ac9-b9c5-db4f2f55c28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:04.970070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898fb73-cc6f-4ac9-b9c5-db4f2f55c28f service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:04.978789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1139/2312] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:06.331493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dea02-c72e-40bb-a084-755a50c73136 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:06.332025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dea02-c72e-40bb-a084-755a50c73136 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:06.332025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dea02-c72e-40bb-a084-755a50c73136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:06.351353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b50dea02-c72e-40bb-a084-755a50c73136 None None] MFA Rules not processed for user `95e2d3743d8a4adea8884143da87a322`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:06.352576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b50dea02-c72e-40bb-a084-755a50c73136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:06.361617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1174/2313] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:14.974819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:16.345796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:18.727858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d1cf-1f4b-49e8-a5a7-e0047857c439 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:18.728344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d1cf-1f4b-49e8-a5a7-e0047857c439 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:18.728443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d1cf-1f4b-49e8-a5a7-e0047857c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:18.750143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d322d1cf-1f4b-49e8-a5a7-e0047857c439 None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:18.751612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d322d1cf-1f4b-49e8-a5a7-e0047857c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:18.818145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1140/2314] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:56:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:18.894323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dea02-c72e-40bb-a084-755a50c73136 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:18.895800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b50dea02-c72e-40bb-a084-755a50c73136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:18.966668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dea02-c72e-40bb-a084-755a50c73136 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:18.971693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614d1b-371b-46f7-a536-8856c4de36db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:18.972808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614d1b-371b-46f7-a536-8856c4de36db service swift] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:18.973092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614d1b-371b-46f7-a536-8856c4de36db service swift] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:18.973369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614d1b-371b-46f7-a536-8856c4de36db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:18.981436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26614d1b-371b-46f7-a536-8856c4de36db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:18.983056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26614d1b-371b-46f7-a536-8856c4de36db service swift] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:18.991687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1175/2315] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:56:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:56:22.001137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322d1cf-1f4b-49e8-a5a7-e0047857c439 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:22.002659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d322d1cf-1f4b-49e8-a5a7-e0047857c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:22.064577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322d1cf-1f4b-49e8-a5a7-e0047857c439 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:22.068366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:22.069214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:22.069575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:22.069923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:22.071823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:22.146018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:22.147652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:22.158246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1141/2316] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:28.244979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623e7e-13b2-48f1-8321-a3237b9a439f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:28.245500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623e7e-13b2-48f1-8321-a3237b9a439f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:28.245500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623e7e-13b2-48f1-8321-a3237b9a439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:28.265016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-63623e7e-13b2-48f1-8321-a3237b9a439f None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:28.266203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-63623e7e-13b2-48f1-8321-a3237b9a439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:28.275014 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1176/2317] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:28.286789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:28.297880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf495c-71ae-4dda-b52d-57f868b303b8 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:28.303474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e7adb-1e47-41c8-ad6c-6a7c4f09b340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:28.304083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e7adb-1e47-41c8-ad6c-6a7c4f09b340 service swift] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:28.304367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e7adb-1e47-41c8-ad6c-6a7c4f09b340 service swift] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:28.304644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e7adb-1e47-41c8-ad6c-6a7c4f09b340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:28.312481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e7adb-1e47-41c8-ad6c-6a7c4f09b340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:28.314050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e7adb-1e47-41c8-ad6c-6a7c4f09b340 service swift] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:28.322560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1142/2318] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:56:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:56:28.834382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56a64-5d23-41b0-b582-9e1964f2ac34 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:28.834677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56a64-5d23-41b0-b582-9e1964f2ac34 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:28.834989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56a64-5d23-41b0-b582-9e1964f2ac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:28.854651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c5e56a64-5d23-41b0-b582-9e1964f2ac34 None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:28.855865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c5e56a64-5d23-41b0-b582-9e1964f2ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:28.863594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1177/2319] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jul 26 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:28.875762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e7adb-1e47-41c8-ad6c-6a7c4f09b340 service swift] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:28.886531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e7adb-1e47-41c8-ad6c-6a7c4f09b340 service swift] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:28.891592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130f6b-19e4-4b5b-861d-57cf93ea0561 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:28.892205 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130f6b-19e4-4b5b-861d-57cf93ea0561 service swift] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:28.892490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130f6b-19e4-4b5b-861d-57cf93ea0561 service swift] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:28.892768 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130f6b-19e4-4b5b-861d-57cf93ea0561 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:28.901961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64130f6b-19e4-4b5b-861d-57cf93ea0561 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:28.903608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64130f6b-19e4-4b5b-861d-57cf93ea0561 service swift] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:28.912261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1143/2320] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:56:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:56:29.133044 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18962f-e179-4333-9eff-f2505872a69e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:29.133362 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18962f-e179-4333-9eff-f2505872a69e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:29.133668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18962f-e179-4333-9eff-f2505872a69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:29.154340 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ce18962f-e179-4333-9eff-f2505872a69e None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:29.155564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ce18962f-e179-4333-9eff-f2505872a69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:29.163239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1178/2321] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:56:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:29.175514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130f6b-19e4-4b5b-861d-57cf93ea0561 service swift] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:29.186007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130f6b-19e4-4b5b-861d-57cf93ea0561 service swift] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:29.191756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c94cd-ac24-444a-900c-9cbc6ebd1d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:29.192376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c94cd-ac24-444a-900c-9cbc6ebd1d5f service swift] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:29.192665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c94cd-ac24-444a-900c-9cbc6ebd1d5f service swift] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:29.192944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c94cd-ac24-444a-900c-9cbc6ebd1d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:29.201668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c94cd-ac24-444a-900c-9cbc6ebd1d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:29.203277 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c94cd-ac24-444a-900c-9cbc6ebd1d5f service swift] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:29.212101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1144/2322] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:56:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:56:29.529904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a28bd9-0e5c-4d15-ae0a-96ef05d815f8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:29.530388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a28bd9-0e5c-4d15-ae0a-96ef05d815f8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:29.530495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a28bd9-0e5c-4d15-ae0a-96ef05d815f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:29.549237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a4a28bd9-0e5c-4d15-ae0a-96ef05d815f8 None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:29.550506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a4a28bd9-0e5c-4d15-ae0a-96ef05d815f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:29.558263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1179/2323] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jul 26 07:56:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:29.570853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c94cd-ac24-444a-900c-9cbc6ebd1d5f service swift] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:29.582150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c94cd-ac24-444a-900c-9cbc6ebd1d5f service swift] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:29.587506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbbde1-8340-49c2-b140-d6371f948197 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:29.588193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbbde1-8340-49c2-b140-d6371f948197 service swift] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:29.588485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbbde1-8340-49c2-b140-d6371f948197 service swift] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:29.588763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbbde1-8340-49c2-b140-d6371f948197 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:29.597529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbbde1-8340-49c2-b140-d6371f948197 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:29.599340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbbde1-8340-49c2-b140-d6371f948197 service swift] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:29.608034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1145/2324] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:56:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:56:31.672197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a28bd9-0e5c-4d15-ae0a-96ef05d815f8 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:31.734426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a28bd9-0e5c-4d15-ae0a-96ef05d815f8 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:31.739586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:31.740225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:31.740509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:31.740791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] PATH_INFO: `/v3/users/95e2d3743d8a4adea8884143da87a322` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:31.741969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e2d3743d8a4adea8884143da87a322)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:31.743924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:31.790583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e2d3743d8a4adea8884143da87a322'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:31.797944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e2d3743d8a4adea8884143da87a322'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:31.805919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e2d3743d8a4adea8884143da87a322'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:31.806606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e2d3743d8a4adea8884143da87a322'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:31.808515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:31.820713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e2d3743d8a4adea8884143da87a322'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:31.833490 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1180/2325] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 07:56:31 2022] DELETE /identity/v3/users/95e2d3743d8a4adea8884143da87a322 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:56:31.838349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3f0d-6c91-453c-abd4-2b9680f74e12 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:31.838872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3f0d-6c91-453c-abd4-2b9680f74e12 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:31.839459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3f0d-6c91-453c-abd4-2b9680f74e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:31.851274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:31.865157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-701c3f0d-6c91-453c-abd4-2b9680f74e12 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:31.866381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-701c3f0d-6c91-453c-abd4-2b9680f74e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:31.929569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1146/2326] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:56:31.939021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:31.940429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:31.996833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c933-1a71-4918-addc-5267c057a040 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:32.000745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee7392-426a-44f4-a0b8-838adcbb72c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:32.001363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7392-426a-44f4-a0b8-838adcbb72c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.001651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7392-426a-44f4-a0b8-838adcbb72c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.001926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee7392-426a-44f4-a0b8-838adcbb72c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.011556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee7392-426a-44f4-a0b8-838adcbb72c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:32.012983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee7392-426a-44f4-a0b8-838adcbb72c8 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:32.022726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1181/2327] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:32.187648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3f0d-6c91-453c-abd4-2b9680f74e12 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:32.189556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-701c3f0d-6c91-453c-abd4-2b9680f74e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:32.223460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3f0d-6c91-453c-abd4-2b9680f74e12 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:32.228270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:32.228916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.229199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.229473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] PATH_INFO: `/v3/projects/750811fe2dc7415ca78d7d470081b552` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.230646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750811fe2dc7415ca78d7d470081b552)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:32.232592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:32.281769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750811fe2dc7415ca78d7d470081b552', 'request_id': 'req-141ccb02-ad61-4103-857b-f07708345633'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:32.288907 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750811fe2dc7415ca78d7d470081b552', 'request_id': 'req-141ccb02-ad61-4103-857b-f07708345633'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:32.296695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750811fe2dc7415ca78d7d470081b552', 'request_id': 'req-141ccb02-ad61-4103-857b-f07708345633'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:32.307755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] The token cache is being invalidate because project 750811fe2dc7415ca78d7d470081b552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 07:56:32.308046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:32.308683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-141ccb02-ad61-4103-857b-f07708345633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 07:56:32.310303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1147/2328] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 07:56:32 2022] DELETE /identity/v3/projects/750811fe2dc7415ca78d7d470081b552 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:56:32.315136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11522b4-73e2-4552-8946-87cdf49e8448 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.315495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11522b4-73e2-4552-8946-87cdf49e8448 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.315839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11522b4-73e2-4552-8946-87cdf49e8448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.336667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a11522b4-73e2-4552-8946-87cdf49e8448 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:32.337877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a11522b4-73e2-4552-8946-87cdf49e8448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:32.405761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1182/2329] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:32.414250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca7f63-df43-4230-b12b-6b2290bc6c78 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.414533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca7f63-df43-4230-b12b-6b2290bc6c78 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.414807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca7f63-df43-4230-b12b-6b2290bc6c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.434437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1dca7f63-df43-4230-b12b-6b2290bc6c78 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:32.435598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1dca7f63-df43-4230-b12b-6b2290bc6c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:32.444043 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1148/2330] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:32.448210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11522b4-73e2-4552-8946-87cdf49e8448 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:32.458594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11522b4-73e2-4552-8946-87cdf49e8448 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:32.463326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:32.463962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.464248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.464524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.465236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 07:56:32.465519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:32.467123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:32.481605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1183/2331] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 07:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 07:56:32.483410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca7f63-df43-4230-b12b-6b2290bc6c78 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:32.493059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca7f63-df43-4230-b12b-6b2290bc6c78 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:32.497757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecc5b8-511e-45e2-a3fc-763dcb17dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:32.498393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecc5b8-511e-45e2-a3fc-763dcb17dbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.498672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecc5b8-511e-45e2-a3fc-763dcb17dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.498967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecc5b8-511e-45e2-a3fc-763dcb17dbf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.499636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecc5b8-511e-45e2-a3fc-763dcb17dbf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:32.501514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecc5b8-511e-45e2-a3fc-763dcb17dbf0 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:32.532152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1149/2332] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 07:56:32 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 07:56:32.533288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:32.543203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859bf32-16cf-456a-8756-888fbb54da50 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:32.605761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9885ced-9a67-4987-bb79-025d228a3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:32.606388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885ced-9a67-4987-bb79-025d228a3c06 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.606666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885ced-9a67-4987-bb79-025d228a3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.606952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885ced-9a67-4987-bb79-025d228a3c06 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.607778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9885ced-9a67-4987-bb79-025d228a3c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:32.609720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9885ced-9a67-4987-bb79-025d228a3c06 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:32.632847 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1184/2333] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 07:56:32 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 07:56:32.637443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecc5b8-511e-45e2-a3fc-763dcb17dbf0 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:32.648929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecc5b8-511e-45e2-a3fc-763dcb17dbf0 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:32.656146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94915bc8-f7d6-44df-b9b6-ec2b62d07e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:32.656862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915bc8-f7d6-44df-b9b6-ec2b62d07e89 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.657171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915bc8-f7d6-44df-b9b6-ec2b62d07e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.657491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915bc8-f7d6-44df-b9b6-ec2b62d07e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.658580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94915bc8-f7d6-44df-b9b6-ec2b62d07e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:32.659903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94915bc8-f7d6-44df-b9b6-ec2b62d07e89 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:32.670445 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1150/2334] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 07:56:32.674497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9885ced-9a67-4987-bb79-025d228a3c06 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:32.680078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:32.686772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9885ced-9a67-4987-bb79-025d228a3c06 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:32.692367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b6fcc-3c68-4318-a1e9-727a65349a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:32.692984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6fcc-3c68-4318-a1e9-727a65349a82 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.693263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6fcc-3c68-4318-a1e9-727a65349a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.693538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b6fcc-3c68-4318-a1e9-727a65349a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.694269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b6fcc-3c68-4318-a1e9-727a65349a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:32.697176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b6fcc-3c68-4318-a1e9-727a65349a82 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:32.708278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1185/2335] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 07:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 07:56:32.712690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94915bc8-f7d6-44df-b9b6-ec2b62d07e89 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:32.723030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94915bc8-f7d6-44df-b9b6-ec2b62d07e89 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:32.729936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:32.730610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.730890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.731225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] PATH_INFO: `/v3/projects/b26ad84b9d4445e7be358f671dbfce96/users/2adcae0906b8475c9853df17155c757e/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.746367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26ad84b9d4445e7be358f671dbfce96, user_id=2adcae0906b8475c9853df17155c757e, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:32.749082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:32.763119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1151/2336] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 07:56:32 2022] PUT /identity/v3/projects/b26ad84b9d4445e7be358f671dbfce96/users/2adcae0906b8475c9853df17155c757e/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 07:56:32.768225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf633-2688-4330-831f-d023f7c07a1f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.768607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf633-2688-4330-831f-d023f7c07a1f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.768961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf633-2688-4330-831f-d023f7c07a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.788752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-693cf633-2688-4330-831f-d023f7c07a1f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:32.789890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-693cf633-2688-4330-831f-d023f7c07a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:32.853139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1186/2337] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:56:32.924019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:32.926572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:32.955388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59229-2f60-4256-abda-0f0d3c3756f3 None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.955596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59229-2f60-4256-abda-0f0d3c3756f3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.955858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59229-2f60-4256-abda-0f0d3c3756f3 None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.957225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1187/2338] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 07:56:32.963136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:32.963316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96757a-df92-42a2-be25-faefb506ab16 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:32.963518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96757a-df92-42a2-be25-faefb506ab16 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:32.963720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96757a-df92-42a2-be25-faefb506ab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:32.985128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ec96757a-df92-42a2-be25-faefb506ab16 None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:32.986382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ec96757a-df92-42a2-be25-faefb506ab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:33.004880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b3f0-6932-4808-8614-d85cf485c614 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:33.009203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:33.009808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.010089 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.010366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.027331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:33.028849 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:33.039195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1152/2339] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:33.070075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1188/2340] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:56:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 07:56:33.082365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:33.083814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:33.148417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b159b-5c19-4d14-b939-6bc8db559143 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:33.152249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ba86c-0b9b-45e8-aebb-3a3b56a5fa45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde6248cf0794fab88a093097b597c9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:33.152935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba86c-0b9b-45e8-aebb-3a3b56a5fa45 service glance] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.153284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba86c-0b9b-45e8-aebb-3a3b56a5fa45 service glance] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.153625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba86c-0b9b-45e8-aebb-3a3b56a5fa45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.164997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ba86c-0b9b-45e8-aebb-3a3b56a5fa45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:33.166626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ba86c-0b9b-45e8-aebb-3a3b56a5fa45 service glance] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:33.179116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1153/2341] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:33.256979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad46fa-c0d8-498e-9c95-c20cd6de3fbe None None] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.257269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad46fa-c0d8-498e-9c95-c20cd6de3fbe None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.257549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad46fa-c0d8-498e-9c95-c20cd6de3fbe None None] PATH_INFO: `/` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.258922 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1189/2342] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:56:33.264270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee79f1f-f71e-4d84-98f3-a8790619b41e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.264561 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee79f1f-f71e-4d84-98f3-a8790619b41e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.264842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee79f1f-f71e-4d84-98f3-a8790619b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.286018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-2ee79f1f-f71e-4d84-98f3-a8790619b41e None None] MFA Rules not processed for user `77a234b8e5f2472cb3e733f933ca1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:33.288040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2ee79f1f-f71e-4d84-98f3-a8790619b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:33.294718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1154/2343] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:56:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:33.307725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad46fa-c0d8-498e-9c95-c20cd6de3fbe None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:33.309422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-11ad46fa-c0d8-498e-9c95-c20cd6de3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:33.323332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad46fa-c0d8-498e-9c95-c20cd6de3fbe None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:33.327029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00705db-616e-41fb-acb4-fdc6d20ba066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:33.327641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00705db-616e-41fb-acb4-fdc6d20ba066 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.327918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00705db-616e-41fb-acb4-fdc6d20ba066 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.328188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00705db-616e-41fb-acb4-fdc6d20ba066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.337043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00705db-616e-41fb-acb4-fdc6d20ba066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:33.338523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00705db-616e-41fb-acb4-fdc6d20ba066 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:33.349382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1190/2344] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:33.455427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf400-807f-4e58-9683-a3d4e9ae6dbd None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.455774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf400-807f-4e58-9683-a3d4e9ae6dbd None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.456001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf400-807f-4e58-9683-a3d4e9ae6dbd None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.458134 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1155/2345] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 07:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 07:56:33.463834 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a039e5-a60a-4a87-a6ee-bf56bd26c211 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.464122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a039e5-a60a-4a87-a6ee-bf56bd26c211 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.464400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a039e5-a60a-4a87-a6ee-bf56bd26c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.485350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-d7a039e5-a60a-4a87-a6ee-bf56bd26c211 None None] MFA Rules not processed for user `867e92c5301945a88e5c0ed06c4b7257`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:33.486583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d7a039e5-a60a-4a87-a6ee-bf56bd26c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:33.497491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1191/2346] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 07:56:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:33.508312 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bf400-807f-4e58-9683-a3d4e9ae6dbd None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:33.520388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bf400-807f-4e58-9683-a3d4e9ae6dbd None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:33.523713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:33.524382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.524664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.524934 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.535770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:33.537256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:33.549266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1156/2347] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:33.728921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318bea-f909-4b9b-856f-9033b85871c1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.729372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318bea-f909-4b9b-856f-9033b85871c1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.729469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318bea-f909-4b9b-856f-9033b85871c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.757792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b7318bea-f909-4b9b-856f-9033b85871c1 None None] MFA Rules not processed for user `2adcae0906b8475c9853df17155c757e`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:33.759065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b7318bea-f909-4b9b-856f-9033b85871c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:33.845566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:33.860651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1192/2348] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:33.872987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:33.875259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:33.937115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c3c0e-8d26-4c99-8454-7f44742828ef service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:33.942433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb8455-a0d4-4edf-8297-52ad2786d4c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:33.943117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8455-a0d4-4edf-8297-52ad2786d4c4 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:33.943467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8455-a0d4-4edf-8297-52ad2786d4c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:33.943672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb8455-a0d4-4edf-8297-52ad2786d4c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:33.953943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb8455-a0d4-4edf-8297-52ad2786d4c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:33.955202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb8455-a0d4-4edf-8297-52ad2786d4c4 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:33.966376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1157/2349] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 07:56:35.388658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6816-a35c-433f-95a8-0722451a0cff None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:35.389223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6816-a35c-433f-95a8-0722451a0cff None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:35.389322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6816-a35c-433f-95a8-0722451a0cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:35.421356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-dd5c6816-a35c-433f-95a8-0722451a0cff None None] MFA Rules not processed for user `2adcae0906b8475c9853df17155c757e`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:35.422694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dd5c6816-a35c-433f-95a8-0722451a0cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:35.430434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1193/2350] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:56:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:37.320538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31bbf-d6b1-4820-8400-35ed8492b122 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:37.321037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31bbf-d6b1-4820-8400-35ed8492b122 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:37.321155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31bbf-d6b1-4820-8400-35ed8492b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:37.344149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5ee31bbf-d6b1-4820-8400-35ed8492b122 None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:56:37.345372 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5ee31bbf-d6b1-4820-8400-35ed8492b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:37.392030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:37.403986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1158/2351] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 07:56:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:56:37.416828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c6816-a35c-433f-95a8-0722451a0cff None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:37.418423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dd5c6816-a35c-433f-95a8-0722451a0cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:37.489027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c6816-a35c-433f-95a8-0722451a0cff None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:37.494194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e280-d756-487f-bac8-f4420726d692 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:37.494828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e280-d756-487f-bac8-f4420726d692 service swift] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:37.495142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e280-d756-487f-bac8-f4420726d692 service swift] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:37.495423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e280-d756-487f-bac8-f4420726d692 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:37.504380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7e280-d756-487f-bac8-f4420726d692 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:37.506017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7e280-d756-487f-bac8-f4420726d692 service swift] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:37.514659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1194/2352] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:56:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:56:47.397944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:47.511803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=38 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:56:54.699952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31bbf-d6b1-4820-8400-35ed8492b122 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:54.709287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31bbf-d6b1-4820-8400-35ed8492b122 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:54.712846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496e9bd-45a2-4b38-8697-9beb92e3bd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:54.713489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e9bd-45a2-4b38-8697-9beb92e3bd69 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:54.713772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e9bd-45a2-4b38-8697-9beb92e3bd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:54.714048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e9bd-45a2-4b38-8697-9beb92e3bd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:54.715846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b496e9bd-45a2-4b38-8697-9beb92e3bd69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:54.729403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496e9bd-45a2-4b38-8697-9beb92e3bd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:54.730821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496e9bd-45a2-4b38-8697-9beb92e3bd69 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:54.741617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1159/2353] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:56:55.698643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e280-d756-487f-bac8-f4420726d692 service swift] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:56:55.708157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e280-d756-487f-bac8-f4420726d692 service swift] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:56:55.712422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:56:55.713055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:56:55.713338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:56:55.713616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:56:55.715398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:56:55.728514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:56:55.729934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:56:55.740712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1195/2354] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:56:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:57:04.736856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:05.736200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:06.042801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ed01-0660-47ee-910f-1ff88fcec853 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:57:06.043306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ed01-0660-47ee-910f-1ff88fcec853 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:57:06.043534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ed01-0660-47ee-910f-1ff88fcec853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:57:06.062784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0d74ed01-0660-47ee-910f-1ff88fcec853 None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:57:06.065176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0d74ed01-0660-47ee-910f-1ff88fcec853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:57:06.077501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1160/2355] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jul 26 07:57:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:57:06.090477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:57:06.101871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f513b-9e8e-4d81-a6cc-dbddabd2d055 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:57:06.107413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d033e-c01a-4360-b4bb-eb945539ca08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:57:06.108358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d033e-c01a-4360-b4bb-eb945539ca08 service swift] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:57:06.108639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d033e-c01a-4360-b4bb-eb945539ca08 service swift] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:57:06.108915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d033e-c01a-4360-b4bb-eb945539ca08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:57:06.117335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d033e-c01a-4360-b4bb-eb945539ca08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:57:06.119367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d033e-c01a-4360-b4bb-eb945539ca08 service swift] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:57:06.130344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1196/2356] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 07:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 07:57:10.060706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74ed01-0660-47ee-910f-1ff88fcec853 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:57:10.062269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0d74ed01-0660-47ee-910f-1ff88fcec853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:57:10.078044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74ed01-0660-47ee-910f-1ff88fcec853 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:57:10.083423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:57:10.084033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:57:10.084311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:57:10.084580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:57:10.086331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:57:10.147045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:57:10.148655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:57:10.158247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1161/2357] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:57:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:57:16.126811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:20.154032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=31 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:22.043565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2890-40d9-48b1-b40b-c5b6d87bdacf None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:57:22.044112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2890-40d9-48b1-b40b-c5b6d87bdacf None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:57:22.044112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2890-40d9-48b1-b40b-c5b6d87bdacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:57:22.062599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-872d2890-40d9-48b1-b40b-c5b6d87bdacf None None] MFA Rules not processed for user `0db0b77cc6ef4b8aa20d0304ec99e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 07:57:22.063825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-872d2890-40d9-48b1-b40b-c5b6d87bdacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:57:22.070507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1197/2358] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 07:57:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 07:57:32.057897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:57:39.750322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:57:39.762077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b46c2-67e2-47c0-8177-f96d81dac674 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:57:39.767463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:57:39.768092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:57:39.768369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:57:39.768641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:57:39.770360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:57:39.827531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:57:39.829113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:57:39.838020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1162/2359] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:57:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:57:49.833908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=28 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:58:29.311184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d2890-40d9-48b1-b40b-c5b6d87bdacf None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:58:29.321159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d2890-40d9-48b1-b40b-c5b6d87bdacf None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:58:29.324950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:58:29.325568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:58:29.325846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:58:29.326119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:58:29.328484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:58:29.338306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:58:29.339769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:58:29.348097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1198/2360] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:58:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:58:29.465842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:58:29.467513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:58:29.482838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8664370-76f0-422b-9672-311a373ee906 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:58:29.488485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:58:29.489191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:58:29.489420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:58:29.489693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:58:29.491598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:58:29.551232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:58:29.552843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:58:29.562410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1163/2361] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:58:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:58:39.344603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:58:39.557631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=28 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 07:59:06.093333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 07:59:06.107505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f644d-2509-4e7f-81cc-8a595d402929 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 07:59:06.113327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 07:59:06.114219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 07:59:06.114509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 07:59:06.114789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 07:59:06.116631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 07:59:06.129425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 07:59:06.131084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 07:59:06.143543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1199/2362] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 07:59:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 07:59:16.138743 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:00:20.208168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:00:20.272506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e600c-8e8e-437d-99fe-709e2790a9ea service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:00:20.277974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:00:20.278579 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:00:20.278859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:00:20.279176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:00:20.280924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:00:20.348127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:00:20.349724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:00:20.358479 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1164/2363] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:00:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:00:30.354382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=56 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:07.309194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:01:07.310627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:01:07.446118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab28b1-2795-4150-bd00-82d2ac9ca331 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:01:07.451255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:01:07.451873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:01:07.452154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:01:07.452429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:01:07.454173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:01:07.465758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:01:07.467454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:01:07.478025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1200/2364] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:01:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:01:17.473778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=63 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:01:56.162071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:01:56.181795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670ab6c-f2b1-46bc-a14d-bed89de697af service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:01:56.185459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d42d8c-ddef-4e60-b309-6a2940dcafce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:01:56.186107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d42d8c-ddef-4e60-b309-6a2940dcafce service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:01:56.186395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d42d8c-ddef-4e60-b309-6a2940dcafce service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:01:56.186674 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d42d8c-ddef-4e60-b309-6a2940dcafce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:01:56.197377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d42d8c-ddef-4e60-b309-6a2940dcafce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:01:56.198822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d42d8c-ddef-4e60-b309-6a2940dcafce service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:01:56.210098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1165/2365] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:01:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:01:57.317862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:01:57.327227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941d50-0f6f-4817-832b-ec9ee0992091 service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:01:57.331930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabee04-3a7e-4236-8799-fee759388fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:01:57.332549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabee04-3a7e-4236-8799-fee759388fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:01:57.332833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabee04-3a7e-4236-8799-fee759388fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:01:57.333108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabee04-3a7e-4236-8799-fee759388fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:01:57.343394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabee04-3a7e-4236-8799-fee759388fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:01:57.344817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabee04-3a7e-4236-8799-fee759388fd8 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:01:57.355607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1201/2366] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:01:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:02:06.204854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=10 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:07.350786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:10.573656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d42d8c-ddef-4e60-b309-6a2940dcafce service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:02:10.585590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d42d8c-ddef-4e60-b309-6a2940dcafce service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:02:10.591238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033382b3-b161-476d-a353-5990bb94476b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:02:10.591847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033382b3-b161-476d-a353-5990bb94476b service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:02:10.592131 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033382b3-b161-476d-a353-5990bb94476b service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:02:10.592408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033382b3-b161-476d-a353-5990bb94476b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:02:10.600955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033382b3-b161-476d-a353-5990bb94476b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:02:10.602545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033382b3-b161-476d-a353-5990bb94476b service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:02:10.629263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1166/2367] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:02:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:02:20.626620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=13 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:02:29.725532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabee04-3a7e-4236-8799-fee759388fd8 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:02:29.744959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabee04-3a7e-4236-8799-fee759388fd8 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:02:29.748618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d788d-c922-4d01-b957-f1592b92d267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:02:29.749230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d788d-c922-4d01-b957-f1592b92d267 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:02:29.749512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d788d-c922-4d01-b957-f1592b92d267 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:02:29.749788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d788d-c922-4d01-b957-f1592b92d267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:02:29.758169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d788d-c922-4d01-b957-f1592b92d267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:02:29.759878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d788d-c922-4d01-b957-f1592b92d267 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:02:29.768593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1202/2368] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:02:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:02:39.764626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=10 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:06.270592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033382b3-b161-476d-a353-5990bb94476b service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:03:06.272083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-033382b3-b161-476d-a353-5990bb94476b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:03:06.295600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033382b3-b161-476d-a353-5990bb94476b service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:03:06.299651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af8c1-3e7a-4bf1-b605-832f9d5ef9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:03:06.300260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af8c1-3e7a-4bf1-b605-832f9d5ef9dc service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:03:06.300533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af8c1-3e7a-4bf1-b605-832f9d5ef9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:03:06.300812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af8c1-3e7a-4bf1-b605-832f9d5ef9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:03:06.309274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2af8c1-3e7a-4bf1-b605-832f9d5ef9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:03:06.310687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2af8c1-3e7a-4bf1-b605-832f9d5ef9dc service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:03:06.339920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1167/2369] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:03:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:03:16.337279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=18 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:03:29.774629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d788d-c922-4d01-b957-f1592b92d267 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:03:29.787031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d788d-c922-4d01-b957-f1592b92d267 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:03:29.792406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a0d92-227e-43af-bce3-98ba61c4efb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:03:29.793011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a0d92-227e-43af-bce3-98ba61c4efb4 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:03:29.793292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a0d92-227e-43af-bce3-98ba61c4efb4 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:03:29.793566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a0d92-227e-43af-bce3-98ba61c4efb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:03:29.801364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a0d92-227e-43af-bce3-98ba61c4efb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:03:29.803017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a0d92-227e-43af-bce3-98ba61c4efb4 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:03:29.830465 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1203/2370] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:03:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:03:39.827287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=13 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:04:03.980412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af8c1-3e7a-4bf1-b605-832f9d5ef9dc service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:04:03.990178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af8c1-3e7a-4bf1-b605-832f9d5ef9dc service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:04:03.993866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:04:03.994477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:04:03.994760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:04:03.995075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:04:04.003133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:04:04.004547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:04:04.012643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1168/2371] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:04:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:04:14.009140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:05:20.338585 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a0d92-227e-43af-bce3-98ba61c4efb4 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:05:20.349845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a0d92-227e-43af-bce3-98ba61c4efb4 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:05:20.355534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3f6d0-d265-4741-a17b-5c42faaa3b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:05:20.356144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f6d0-d265-4741-a17b-5c42faaa3b3d service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:05:20.356448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f6d0-d265-4741-a17b-5c42faaa3b3d service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:05:20.356756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f6d0-d265-4741-a17b-5c42faaa3b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:05:20.364660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3f6d0-d265-4741-a17b-5c42faaa3b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:05:20.366275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3f6d0-d265-4741-a17b-5c42faaa3b3d service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:05:20.393729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1204/2372] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:05:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:05:30.391157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=13 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:06:11.292987 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:06:11.294776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:06:11.310014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b0c45-e51a-44b5-99d4-b26d976665d4 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:06:11.315187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a64bef-0bbc-4bce-8d75-f9a178f35f7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:06:11.315796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64bef-0bbc-4bce-8d75-f9a178f35f7c service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:06:11.316078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64bef-0bbc-4bce-8d75-f9a178f35f7c service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:06:11.316354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64bef-0bbc-4bce-8d75-f9a178f35f7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:06:11.324685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a64bef-0bbc-4bce-8d75-f9a178f35f7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:06:11.326245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a64bef-0bbc-4bce-8d75-f9a178f35f7c service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:06:11.336408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1169/2373] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:06:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:06:21.331789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:06.629325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3f6d0-d265-4741-a17b-5c42faaa3b3d service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:07:06.683048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3f6d0-d265-4741-a17b-5c42faaa3b3d service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:07:06.686595 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:07:06.687226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:07:06.687507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:07:06.687777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:07:06.689609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:07:06.769753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:07:06.771206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:07:06.782536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1205/2374] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:07:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:07:06.830760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a64bef-0bbc-4bce-8d75-f9a178f35f7c service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:07:06.842341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a64bef-0bbc-4bce-8d75-f9a178f35f7c service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:07:06.848321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:07:06.848928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:07:06.849580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:07:06.849580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:07:06.851416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:07:06.865554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:07:06.867056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:07:06.878020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1170/2375] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:07:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:07:16.777792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=59 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:16.873213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:07:30.187775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:07:30.198859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64509-0d15-4554-ab47-557f9b477d0a service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:07:30.204403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:07:30.205009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:07:30.205289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:07:30.205563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:07:30.207427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:07:30.285100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:07:30.286696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:07:30.305009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1206/2376] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:07:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:07:40.302291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=41 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:08:30.402175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:08:30.403354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:08:30.414248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad3fc8-2a02-4668-b1d2-14a2a712fa3e service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:08:30.417923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:08:30.418538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:08:30.418820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:08:30.419341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:08:30.421241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:08:30.501914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:08:30.503614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:08:30.505656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:08:30.507201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:08:30.517254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1171/2377] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:08:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:08:30.522077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27096192-1ab5-48c1-ac20-77c0349985f2 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:08:30.527499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:08:30.528141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:08:30.528421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:08:30.528698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:08:30.530553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:08:30.564864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:08:30.574461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612e452-6be1-44e6-8821-157054496643 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:08:30.578109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:08:30.578716 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:08:30.579021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:08:30.579301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:08:30.581194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:08:30.603991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:08:30.606195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:08:30.616129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1207/2378] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:08:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:08:30.651717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:08:30.653147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:08:30.662070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1172/2379] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:08:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:08:40.611204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=33 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:08:40.657850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=66 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:09:11.944703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:09:11.946339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:09:12.013300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100669c-edae-4709-b4c9-ff13c53c1f8d service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:09:12.016865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:09:12.017473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:09:12.017780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:09:12.018053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:09:12.019906 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:09:12.029685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:09:12.031128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:09:12.038824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1208/2380] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:09:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:09:22.035364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=31 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:10:20.781067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:10:20.789532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532cea-ef72-4545-8d1e-f86e1a123627 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:10:20.793640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:10:20.794239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:10:20.794514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:10:20.794784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:10:20.796644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:10:20.869314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:10:20.870690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:10:20.881956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1173/2381] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:10:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:10:30.876099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=33 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:11:17.234150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:11:17.358749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495356-3778-4bc2-ab55-f206be292acd service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:11:17.364151 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:11:17.364776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:11:17.365055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:11:17.365328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:11:17.367237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:11:17.402741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:11:17.404392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:11:17.414854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1209/2382] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:11:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:11:27.410062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=63 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:12:05.479271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:12:05.507884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f34dd0-757f-450d-b336-caedcd30a06c service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:12:05.511442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7085f6-e459-4080-b6d6-dfbd3bd365de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:12:05.512048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7085f6-e459-4080-b6d6-dfbd3bd365de service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:12:05.512333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7085f6-e459-4080-b6d6-dfbd3bd365de service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:12:05.512601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7085f6-e459-4080-b6d6-dfbd3bd365de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:12:05.530812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7085f6-e459-4080-b6d6-dfbd3bd365de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:12:05.532314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7085f6-e459-4080-b6d6-dfbd3bd365de service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:12:05.554149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1174/2383] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:12:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:12:05.639226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:12:05.641306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:12:05.656726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29140b1-e883-4d58-a6b1-d24c56048d9a service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:12:05.660477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:12:05.661150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:12:05.661438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:12:05.661715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:12:05.674264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:12:05.676128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:12:05.689111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1210/2384] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:12:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:12:15.551597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=22 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:12:15.684455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:12:30.051276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7085f6-e459-4080-b6d6-dfbd3bd365de service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:12:30.070292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7085f6-e459-4080-b6d6-dfbd3bd365de service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:12:30.073926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016dd61-f6e4-4d24-a06b-68f9b46d6634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:12:30.074538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016dd61-f6e4-4d24-a06b-68f9b46d6634 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:12:30.074822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016dd61-f6e4-4d24-a06b-68f9b46d6634 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:12:30.075132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016dd61-f6e4-4d24-a06b-68f9b46d6634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:12:30.083408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016dd61-f6e4-4d24-a06b-68f9b46d6634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:12:30.084832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016dd61-f6e4-4d24-a06b-68f9b46d6634 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:12:30.094066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1175/2385] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:12:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:12:40.089666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=10 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:13:30.947431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:13:30.949045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:13:30.963480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4364a-97fd-44fe-9c94-3b6f95074b09 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:13:30.969302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d715db2-f2e2-4673-a662-bc2bb02ef841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:13:30.969902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d715db2-f2e2-4673-a662-bc2bb02ef841 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:13:30.970180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d715db2-f2e2-4673-a662-bc2bb02ef841 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:13:30.970449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d715db2-f2e2-4673-a662-bc2bb02ef841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:13:30.978107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d715db2-f2e2-4673-a662-bc2bb02ef841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:13:30.979719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d715db2-f2e2-4673-a662-bc2bb02ef841 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:13:31.007319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1211/2386] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:13:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:13:31.260521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016dd61-f6e4-4d24-a06b-68f9b46d6634 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:13:31.269684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016dd61-f6e4-4d24-a06b-68f9b46d6634 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:13:31.273390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2cc55-f4cc-4fa2-80d9-674d83e2ced0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:13:31.273995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2cc55-f4cc-4fa2-80d9-674d83e2ced0 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:13:31.274279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2cc55-f4cc-4fa2-80d9-674d83e2ced0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:13:31.274553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2cc55-f4cc-4fa2-80d9-674d83e2ced0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:13:31.283759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2cc55-f4cc-4fa2-80d9-674d83e2ced0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:13:31.285206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2cc55-f4cc-4fa2-80d9-674d83e2ced0 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:13:31.311294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1176/2387] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:13:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:13:31.556809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d715db2-f2e2-4673-a662-bc2bb02ef841 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:13:31.568380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d715db2-f2e2-4673-a662-bc2bb02ef841 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:13:31.573868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7815d57-a1af-4069-a86a-babe90f5dc45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:13:31.574472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7815d57-a1af-4069-a86a-babe90f5dc45 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:13:31.574756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7815d57-a1af-4069-a86a-babe90f5dc45 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:13:31.575072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7815d57-a1af-4069-a86a-babe90f5dc45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:13:31.583571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7815d57-a1af-4069-a86a-babe90f5dc45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:13:31.585142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7815d57-a1af-4069-a86a-babe90f5dc45 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:13:31.612276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1212/2388] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:13:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:13:41.308775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=13 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:13:41.609737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=26 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:14:14.958516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2cc55-f4cc-4fa2-80d9-674d83e2ced0 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:14:14.968381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2cc55-f4cc-4fa2-80d9-674d83e2ced0 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:14:14.971961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332f2f2-ef64-4ff0-9bca-3b829ccc74f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:14:14.972567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332f2f2-ef64-4ff0-9bca-3b829ccc74f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:14:14.972848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332f2f2-ef64-4ff0-9bca-3b829ccc74f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:14:14.973125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332f2f2-ef64-4ff0-9bca-3b829ccc74f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:14:14.980220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332f2f2-ef64-4ff0-9bca-3b829ccc74f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:14:14.981641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332f2f2-ef64-4ff0-9bca-3b829ccc74f9 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:14:14.990632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1177/2389] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:14:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:14:24.986638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:15:07.859124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7815d57-a1af-4069-a86a-babe90f5dc45 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:15:07.870448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7815d57-a1af-4069-a86a-babe90f5dc45 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:15:07.874039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:15:07.874658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:15:07.874950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:15:07.875495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:15:07.877328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:15:07.960904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:15:07.962268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:15:07.980990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1213/2390] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:15:11.446123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332f2f2-ef64-4ff0-9bca-3b829ccc74f9 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:15:11.458667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332f2f2-ef64-4ff0-9bca-3b829ccc74f9 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:15:11.463682 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:15:11.464294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:15:11.464579 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:15:11.464853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:15:11.466576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:15:11.478213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:15:11.480002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:15:11.491488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1178/2391] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:15:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:15:15.106748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:15:15.108319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:15:15.120690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140899f5-0686-4f01-b70e-bccf5457f75f service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:15:15.125576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:15:15.126242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:15:15.127071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:15:15.127349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] PATH_INFO: `/v3/users/3c58a61adbd74ae58da8dec020922451` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:15:15.128542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c58a61adbd74ae58da8dec020922451)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:15:15.130465 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:15:15.176506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c58a61adbd74ae58da8dec020922451'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.183312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c58a61adbd74ae58da8dec020922451'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.191117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c58a61adbd74ae58da8dec020922451'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.191761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c58a61adbd74ae58da8dec020922451'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.203370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c58a61adbd74ae58da8dec020922451'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.209755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1214/2392] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:15:15 2022] DELETE /identity/v3/users/3c58a61adbd74ae58da8dec020922451 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:15:15.377739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:15:15.388624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd14aee-955b-49d4-b450-e529df61842c service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:15:15.448573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:15:15.449135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:15:15.449420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:15:15.449695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] PATH_INFO: `/v3/projects/9fcfa639dca64a8c889a13e92ae5e57f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:15:15.450893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fcfa639dca64a8c889a13e92ae5e57f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:15:15.452816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:15:15.501175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fcfa639dca64a8c889a13e92ae5e57f', 'request_id': 'req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.508126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fcfa639dca64a8c889a13e92ae5e57f', 'request_id': 'req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.515795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fcfa639dca64a8c889a13e92ae5e57f', 'request_id': 'req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.526753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] The token cache is being invalidate because project 9fcfa639dca64a8c889a13e92ae5e57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:15:15.527148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.527803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.529351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1179/2393] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:15:15 2022] DELETE /identity/v3/projects/9fcfa639dca64a8c889a13e92ae5e57f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:15:15.533547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:15:15.535083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:15:15.551061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60ba09-e99f-4de2-a2f3-63302565441a admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:15:15.584419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:15:15.609469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:15:15.610105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:15:15.610384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:15:15.610658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] PATH_INFO: `/v3/users/a80324d896d04ec681d8b52100535fdc` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:15:15.624134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80324d896d04ec681d8b52100535fdc)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:15:15.626341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:15:15.670571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80324d896d04ec681d8b52100535fdc'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.678379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80324d896d04ec681d8b52100535fdc'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.685586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80324d896d04ec681d8b52100535fdc'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.686226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80324d896d04ec681d8b52100535fdc'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.698004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80324d896d04ec681d8b52100535fdc'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:15.703868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1215/2394] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:15:15 2022] DELETE /identity/v3/users/a80324d896d04ec681d8b52100535fdc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:15:15.951764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:15:15.953516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:15:15.966502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c1cde-2bcd-43be-9d2d-0d8446f0b0da admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:15:16.051427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:15:16.052082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:15:16.052369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:15:16.052645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] PATH_INFO: `/v3/projects/9c87913a5c3f4ea6acc9fbdbc80aa4c1` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:15:16.063523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c87913a5c3f4ea6acc9fbdbc80aa4c1)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:15:16.066128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:15:16.079110 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:15:16.119053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c87913a5c3f4ea6acc9fbdbc80aa4c1', 'request_id': 'req-e7a158f7-09fe-46c7-966d-d50b14300d75'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:16.126328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c87913a5c3f4ea6acc9fbdbc80aa4c1', 'request_id': 'req-e7a158f7-09fe-46c7-966d-d50b14300d75'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:16.135942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c87913a5c3f4ea6acc9fbdbc80aa4c1', 'request_id': 'req-e7a158f7-09fe-46c7-966d-d50b14300d75'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:16.146703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] The token cache is being invalidate because project 9c87913a5c3f4ea6acc9fbdbc80aa4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:15:16.147020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:16.147654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:15:16.149184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1180/2395] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:15:15 2022] DELETE /identity/v3/projects/9c87913a5c3f4ea6acc9fbdbc80aa4c1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:15:25.700322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:15:26.143650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:16:21.235283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:16:21.236695 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:16:21.303807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c8ec0-c3f5-4c0b-96c6-95d4b792c8cb admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:16:21.362224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:16:21.362852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:16:21.363168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:16:21.363462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:16:21.365341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:16:21.377018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:16:21.378658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:16:21.388827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1216/2396] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:16:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:16:31.384556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=58 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:17:05.692232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:17:05.693879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:05.750003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a158f7-09fe-46c7-966d-d50b14300d75 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:17:05.753607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:17:05.754704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:05.755019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:05.755296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:05.757038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:05.824594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:17:05.826021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:17:05.837695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1181/2397] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:17:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:17:06.309499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:17:06.310917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:06.322959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b0eb4-c906-469a-909c-a0fbfd2156d2 service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:17:06.326681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:17:06.327317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:06.327598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:06.327871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:06.329542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:06.342447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:17:06.343926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:17:06.354590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1217/2398] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:17:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:17:07.576947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:17:07.580912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:07.615339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e90500-e22b-4326-9bd3-6abe2a82a77c service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:17:07.623617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02679a04-640e-4647-8270-9eb18584cd10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:17:07.624756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679a04-640e-4647-8270-9eb18584cd10 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:07.625623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679a04-640e-4647-8270-9eb18584cd10 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:07.626111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679a04-640e-4647-8270-9eb18584cd10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:07.628979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-02679a04-640e-4647-8270-9eb18584cd10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:07.652390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02679a04-640e-4647-8270-9eb18584cd10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:17:07.656620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02679a04-640e-4647-8270-9eb18584cd10 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:17:07.669978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1182/2399] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:17:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:17:07.737326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:17:07.740347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:07.833722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cc0c7-0c48-4720-998c-b66da9a23399 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:17:07.844348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:17:07.845028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:07.845317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:07.845594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:07.851899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:07.865270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:17:07.866963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:17:07.882890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1218/2400] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:17:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:17:11.011724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d66585-39ee-4510-992b-d3a1c839949f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:11.012223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d66585-39ee-4510-992b-d3a1c839949f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:11.012362 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d66585-39ee-4510-992b-d3a1c839949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:11.043420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a3d66585-39ee-4510-992b-d3a1c839949f None None] MFA Rules not processed for user `19beebc60ea348c0b09cdb926218ce6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:17:11.044784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a3d66585-39ee-4510-992b-d3a1c839949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:11.100850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1183/2401] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:17:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:17:11.431432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:17:11.441040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dea1f-ea39-4ebb-91c2-b2bf49c0ec3c service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:17:11.445514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:17:11.446436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:11.446975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:11.447606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:11.450252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:11.462865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:17:11.464619 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:17:11.474093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1219/2402] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:17:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:17:11.822417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d66585-39ee-4510-992b-d3a1c839949f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:17:11.823872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a3d66585-39ee-4510-992b-d3a1c839949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:11.839389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d66585-39ee-4510-992b-d3a1c839949f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:17:11.851676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:17:11.852423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:11.853079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:11.853983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:11.856341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:11.870218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:17:11.872020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:17:11.883967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1184/2403] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:17:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:17:21.470085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=23 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:17:21.791106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:17:21.804819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb44af-1cda-484b-88f1-f5ff1cb9cdf2 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:17:21.810319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:17:21.810964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:21.811244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:21.811522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:21.813588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:21.826643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:17:21.828256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:17:21.842968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1220/2404] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:17:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:17:21.878745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:17:30.467526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:17:30.479363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f89fac-2c0c-40ba-87ae-efdd18bf056b service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:17:30.484729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:17:30.485330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:17:30.485614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:17:30.485891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:17:30.487628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:17:30.564418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:17:30.565994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:17:30.584733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1185/2405] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:17:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:17:31.834947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:17:40.581622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=41 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:18:31.303210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:18:31.305274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:18:31.383216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09424ebd-26fa-4b86-936e-682726d2a5c7 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:18:31.387477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:18:31.388142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:18:31.388420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:18:31.388782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:18:31.390685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:18:31.468596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:18:31.470060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:18:31.479664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1221/2406] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:18:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:18:31.566014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:18:31.575455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e1f3b-06ba-4869-99bc-69101b71b330 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:18:31.579236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:18:31.579874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:18:31.580161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:18:31.580441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:18:31.582204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:18:31.606468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:18:31.607921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:18:31.616801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1186/2407] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:18:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:18:31.890263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:18:31.905686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce41e4-33bc-4022-b4f8-7355a367c777 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:18:31.911612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:18:31.912316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:18:31.912627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:18:31.912918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:18:31.914784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:18:31.986341 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:18:31.988013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:18:31.996921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1222/2408] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:18:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:18:41.612599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=11 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:18:41.992727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=91 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:19:21.947489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:19:21.956937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef415e0-d9a2-44db-9d9e-01aeead8176a service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:19:21.961034 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:19:21.961650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:19:21.961939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:19:21.962214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:19:21.964007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:19:21.985553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:19:21.986921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:19:21.995431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1187/2409] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:19:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:19:31.991813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=11 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:21:26.225484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:21:26.274569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53c8a-7961-48d1-af2b-7c908676004f service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:21:26.280342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda04d8-a406-44d5-9921-2a609977b8c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:21:26.280960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda04d8-a406-44d5-9921-2a609977b8c8 service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:21:26.281248 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda04d8-a406-44d5-9921-2a609977b8c8 service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:21:26.281523 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda04d8-a406-44d5-9921-2a609977b8c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:21:26.290045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda04d8-a406-44d5-9921-2a609977b8c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:21:26.291688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda04d8-a406-44d5-9921-2a609977b8c8 service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:21:26.301734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1223/2410] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:21:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:21:36.297332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=22 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:22:06.721672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:22:06.756833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8e246-dc8e-4255-ab6a-51fd2d6f5669 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:22:06.760914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688af7f-548c-4bf9-9b68-44cf101f4a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:22:06.761516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688af7f-548c-4bf9-9b68-44cf101f4a47 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:22:06.761795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688af7f-548c-4bf9-9b68-44cf101f4a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:22:06.762066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688af7f-548c-4bf9-9b68-44cf101f4a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:22:06.779288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688af7f-548c-4bf9-9b68-44cf101f4a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:22:06.780702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688af7f-548c-4bf9-9b68-44cf101f4a47 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:22:06.800532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1188/2411] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:22:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:22:07.906855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda04d8-a406-44d5-9921-2a609977b8c8 service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:22:07.925525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda04d8-a406-44d5-9921-2a609977b8c8 service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:22:07.929217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fa288-b7a6-4f87-821d-f3600acaf1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:22:07.929824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fa288-b7a6-4f87-821d-f3600acaf1de service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:22:07.930102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fa288-b7a6-4f87-821d-f3600acaf1de service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:22:07.930373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fa288-b7a6-4f87-821d-f3600acaf1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:22:07.940868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fa288-b7a6-4f87-821d-f3600acaf1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:22:07.942278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fa288-b7a6-4f87-821d-f3600acaf1de service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:22:07.953625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1224/2412] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:22:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:22:16.797988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=25 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:22:17.948902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=11 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:23:09.339456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b0f5-8570-4ec1-b28b-9731f150e96e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:23:09.340040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b0f5-8570-4ec1-b28b-9731f150e96e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:23:09.340040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b0f5-8570-4ec1-b28b-9731f150e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:23:09.377556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b519b0f5-8570-4ec1-b28b-9731f150e96e None None] MFA Rules not processed for user `c42352a47bf04dadaa592a4b18fc2340`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:23:09.378765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b519b0f5-8570-4ec1-b28b-9731f150e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:23:09.385731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1189/2413] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:23:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:23:09.686420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fa288-b7a6-4f87-821d-f3600acaf1de service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:23:09.694898 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fa288-b7a6-4f87-821d-f3600acaf1de service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:23:09.698507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:23:09.699142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:23:09.699426 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:23:09.699704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:23:09.701434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:23:09.711187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:23:09.712606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:23:09.721221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1225/2414] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:23:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:23:10.038989 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b0f5-8570-4ec1-b28b-9731f150e96e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:23:10.051283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b0f5-8570-4ec1-b28b-9731f150e96e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:23:10.056318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f43a31-df92-4bc8-9894-d0b2461e9056 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:23:10.056939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43a31-df92-4bc8-9894-d0b2461e9056 service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:23:10.057222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43a31-df92-4bc8-9894-d0b2461e9056 service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:23:10.057498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43a31-df92-4bc8-9894-d0b2461e9056 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:23:10.067027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f43a31-df92-4bc8-9894-d0b2461e9056 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:23:10.068616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f43a31-df92-4bc8-9894-d0b2461e9056 service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:23:10.079906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1190/2415] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:23:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:23:11.463552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:23:11.465157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:23:11.487538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb8e7-c335-49fa-9e29-76bfa32cfe4c service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:23:11.491196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df0acf-d5b7-4358-8774-1f1ba6cd8a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:23:11.491815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df0acf-d5b7-4358-8774-1f1ba6cd8a37 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:23:11.492098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df0acf-d5b7-4358-8774-1f1ba6cd8a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:23:11.492373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df0acf-d5b7-4358-8774-1f1ba6cd8a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:23:11.501896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df0acf-d5b7-4358-8774-1f1ba6cd8a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:23:11.503365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df0acf-d5b7-4358-8774-1f1ba6cd8a37 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:23:11.512367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1226/2416] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:23:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:23:12.477137 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f43a31-df92-4bc8-9894-d0b2461e9056 service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:23:12.491779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f43a31-df92-4bc8-9894-d0b2461e9056 service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:23:12.499090 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a68ef-ed29-4862-aef4-2cfb6680b81f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:23:12.499839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a68ef-ed29-4862-aef4-2cfb6680b81f service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:23:12.500309 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a68ef-ed29-4862-aef4-2cfb6680b81f service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:23:12.500786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a68ef-ed29-4862-aef4-2cfb6680b81f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:23:12.510702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a68ef-ed29-4862-aef4-2cfb6680b81f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:23:12.512493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a68ef-ed29-4862-aef4-2cfb6680b81f service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:23:12.525509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1191/2417] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:23:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:23:17.680091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df0acf-d5b7-4358-8774-1f1ba6cd8a37 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:23:17.693919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df0acf-d5b7-4358-8774-1f1ba6cd8a37 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:23:17.699456 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f4e8-1293-4389-860f-636c1c900fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:23:17.700067 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f4e8-1293-4389-860f-636c1c900fcf service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:23:17.700379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f4e8-1293-4389-860f-636c1c900fcf service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:23:17.700650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f4e8-1293-4389-860f-636c1c900fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:23:17.710572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8f4e8-1293-4389-860f-636c1c900fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:23:17.712268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8f4e8-1293-4389-860f-636c1c900fcf service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:23:17.723855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1227/2418] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:23:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:23:22.520216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=22 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:23:27.718540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=22 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:24:27.952389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a68ef-ed29-4862-aef4-2cfb6680b81f service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:24:27.961916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a68ef-ed29-4862-aef4-2cfb6680b81f service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:24:27.965457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f88f6-c73b-4813-8673-6e37526a4697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:24:27.966056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f88f6-c73b-4813-8673-6e37526a4697 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:24:27.966337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f88f6-c73b-4813-8673-6e37526a4697 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:24:27.966610 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f88f6-c73b-4813-8673-6e37526a4697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:24:27.974327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f88f6-c73b-4813-8673-6e37526a4697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:24:27.975717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f88f6-c73b-4813-8673-6e37526a4697 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:24:27.983431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1192/2419] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:24:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:24:32.306343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f4e8-1293-4389-860f-636c1c900fcf service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:24:32.315890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f4e8-1293-4389-860f-636c1c900fcf service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:24:32.319499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba39a3-b732-464d-9fa5-26a5becd04c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:24:32.320108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba39a3-b732-464d-9fa5-26a5becd04c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:24:32.320393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba39a3-b732-464d-9fa5-26a5becd04c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:24:32.320670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba39a3-b732-464d-9fa5-26a5becd04c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:24:32.329060 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba39a3-b732-464d-9fa5-26a5becd04c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:24:32.330477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba39a3-b732-464d-9fa5-26a5becd04c5 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:24:32.357383 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1228/2420] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:24:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:24:36.971066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f88f6-c73b-4813-8673-6e37526a4697 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:24:36.983663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f88f6-c73b-4813-8673-6e37526a4697 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:24:36.989039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:24:36.989634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:24:36.989912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:24:36.990185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:24:36.998208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:24:36.999808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:24:37.029532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1193/2421] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:24:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:24:42.354796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=13 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:24:47.026128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=19 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:25:11.832123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba39a3-b732-464d-9fa5-26a5becd04c5 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:25:11.841285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba39a3-b732-464d-9fa5-26a5becd04c5 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:25:11.847768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:25:11.848499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:25:11.849217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:25:11.849217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:25:11.858131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:25:11.859603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:25:11.888004 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1229/2422] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:25:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:25:21.885371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=13 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:26:33.223717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:26:33.225144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:26:33.303366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a8d8-f4cb-4858-a54d-285e22dd0bf9 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:26:33.308852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:26:33.309493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:26:33.309777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:26:33.310052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:26:33.311886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:26:33.323553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:26:33.325130 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:26:33.334790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1194/2423] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:26:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:26:43.330630 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=37 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:28:32.668860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:32.670429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:32.737605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee456-3a4a-471f-b701-614caf96ea47 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:32.741406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:32.742048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:32.742332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:32.742608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:32.744484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:32.821788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:32.823240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:32.841089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1230/2424] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:28:38.714600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:38.716335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:38.773559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e473-7436-4615-925c-16f82d8a7f58 service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:38.777232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:38.777852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:38.778168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:38.778484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:38.780576 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:38.872984 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:38.874438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:38.885327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1195/2425] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:28:40.065323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:40.067042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:40.079188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf992a4-e78b-4b08-9d03-29944aef0568 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:40.082709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:40.083344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:40.083623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:40.083894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:40.085660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:40.098603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:40.100094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:40.111700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1231/2426] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:28:43.909187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:43.910789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:43.925222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93f191-c4ce-4461-a79b-bcaba82a2dc7 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:43.932695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0674-cc90-4db5-87cf-3190b24eb2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:43.933653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0674-cc90-4db5-87cf-3190b24eb2a2 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:43.934156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0674-cc90-4db5-87cf-3190b24eb2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:43.934506 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0674-cc90-4db5-87cf-3190b24eb2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:43.937712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c4ce0674-cc90-4db5-87cf-3190b24eb2a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:43.952733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0674-cc90-4db5-87cf-3190b24eb2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:43.955704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0674-cc90-4db5-87cf-3190b24eb2a2 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:43.971601 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1196/2427] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:28:44.604167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:44.608553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:44.638411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e05c4-c5b0-47fd-a470-976d9f77bba6 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:44.647319 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:44.648362 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:44.648895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:44.649410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:44.652182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:44.667055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:44.669466 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:44.681402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1232/2428] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:28:45.039637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce501a21-5b2a-4e0d-af61-9416d5bd602a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:45.040135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce501a21-5b2a-4e0d-af61-9416d5bd602a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:45.040257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce501a21-5b2a-4e0d-af61-9416d5bd602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:45.071424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ce501a21-5b2a-4e0d-af61-9416d5bd602a None None] MFA Rules not processed for user `2adcae0906b8475c9853df17155c757e`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:28:45.072637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ce501a21-5b2a-4e0d-af61-9416d5bd602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:45.079854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1197/2429] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:28:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:28:45.322350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:45.332928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5148-2507-433a-a2e0-f01e073f000c service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:45.336833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:45.337700 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:45.337986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:45.338263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:45.340875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:45.351172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:45.352806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:45.361734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1233/2430] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:28:47.723935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce501a21-5b2a-4e0d-af61-9416d5bd602a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:47.737243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce501a21-5b2a-4e0d-af61-9416d5bd602a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:47.743354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0895d-bbe6-4f8c-9708-19a28d6381f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:47.743977 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0895d-bbe6-4f8c-9708-19a28d6381f9 service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:47.744260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0895d-bbe6-4f8c-9708-19a28d6381f9 service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:47.745086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0895d-bbe6-4f8c-9708-19a28d6381f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:47.747918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ded0895d-bbe6-4f8c-9708-19a28d6381f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:47.761846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0895d-bbe6-4f8c-9708-19a28d6381f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:47.763482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0895d-bbe6-4f8c-9708-19a28d6381f9 service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:47.775543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1198/2431] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:28:48.443101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:48.452270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0c159-907d-49a3-89e9-3221930c045d service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:48.455882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b64abf-ed6a-4f6e-a5b1-c3550fc76031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:48.456494 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b64abf-ed6a-4f6e-a5b1-c3550fc76031 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:48.456773 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b64abf-ed6a-4f6e-a5b1-c3550fc76031 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:48.457045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b64abf-ed6a-4f6e-a5b1-c3550fc76031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:48.458795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-87b64abf-ed6a-4f6e-a5b1-c3550fc76031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:48.495119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:28:48.547602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b64abf-ed6a-4f6e-a5b1-c3550fc76031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:48.549040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b64abf-ed6a-4f6e-a5b1-c3550fc76031 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:48.567482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1234/2432] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:28:51.771350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf268a5-cab5-4103-98af-e370f8a22294 None None] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:51.771983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf268a5-cab5-4103-98af-e370f8a22294 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:51.771983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf268a5-cab5-4103-98af-e370f8a22294 None None] PATH_INFO: `/` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:51.773283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1199/2433] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jul 26 08:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 08:28:51.810827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce533f-a8b3-4a24-ba75-911f258b4a45 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:51.811359 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce533f-a8b3-4a24-ba75-911f258b4a45 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:51.811998 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce533f-a8b3-4a24-ba75-911f258b4a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:51.909278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf268a5-cab5-4103-98af-e370f8a22294 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:51.910822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-57ce533f-a8b3-4a24-ba75-911f258b4a45 None None] MFA Rules not processed for user `e98df09d65184729b62b2ae1904a27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:28:51.912680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9bf268a5-cab5-4103-98af-e370f8a22294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:51.914492 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-57ce533f-a8b3-4a24-ba75-911f258b4a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:51.934914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf268a5-cab5-4103-98af-e370f8a22294 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:51.940191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:51.941447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:51.942410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:51.942781 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] PATH_INFO: `/v3/users/0db0b77cc6ef4b8aa20d0304ec99e5e8` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:51.945981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1235/2434] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jul 26 08:28:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:28:51.961056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce533f-a8b3-4a24-ba75-911f258b4a45 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:51.962648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-57ce533f-a8b3-4a24-ba75-911f258b4a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:51.974812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db0b77cc6ef4b8aa20d0304ec99e5e8)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:51.987194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce533f-a8b3-4a24-ba75-911f258b4a45 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:51.989478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:51.993107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cae3fc-3f18-4a39-8504-aecc8c51d1fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:51.993934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae3fc-3f18-4a39-8504-aecc8c51d1fa service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:51.994297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae3fc-3f18-4a39-8504-aecc8c51d1fa service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:51.994664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae3fc-3f18-4a39-8504-aecc8c51d1fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.005629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cae3fc-3f18-4a39-8504-aecc8c51d1fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:52.007354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cae3fc-3f18-4a39-8504-aecc8c51d1fa service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:52.017992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1236/2435] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:28:52.044663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:28:52.057259 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db0b77cc6ef4b8aa20d0304ec99e5e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.067069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db0b77cc6ef4b8aa20d0304ec99e5e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.067770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db0b77cc6ef4b8aa20d0304ec99e5e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.082462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db0b77cc6ef4b8aa20d0304ec99e5e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.083342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4e98f587-67c1-4f9e-ae55-5ba9cbfe7d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db0b77cc6ef4b8aa20d0304ec99e5e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.097022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1200/2436] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:28:51 2022] DELETE /identity/v3/users/0db0b77cc6ef4b8aa20d0304ec99e5e8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:28:52.316817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cae3fc-3f18-4a39-8504-aecc8c51d1fa service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:52.330458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cae3fc-3f18-4a39-8504-aecc8c51d1fa service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:52.396007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:52.396605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.396887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.397165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] PATH_INFO: `/v3/projects/a34edb14f04144619e2fcac7f2b8d8aa` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.398462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34edb14f04144619e2fcac7f2b8d8aa)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:52.400428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:52.447753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34edb14f04144619e2fcac7f2b8d8aa', 'request_id': 'req-40bb1241-b7f3-4a00-8144-f8384585d9c2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.450391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:28:52.462206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34edb14f04144619e2fcac7f2b8d8aa', 'request_id': 'req-40bb1241-b7f3-4a00-8144-f8384585d9c2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.470902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34edb14f04144619e2fcac7f2b8d8aa', 'request_id': 'req-40bb1241-b7f3-4a00-8144-f8384585d9c2'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.487438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] The token cache is being invalidate because project a34edb14f04144619e2fcac7f2b8d8aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:28:52.487438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.488065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bb1241-b7f3-4a00-8144-f8384585d9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:28:52.489900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1237/2437] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:28:52 2022] DELETE /identity/v3/projects/a34edb14f04144619e2fcac7f2b8d8aa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:28:52.496383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f223-1dbe-451f-8051-bfb3829cbdd8 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.496673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f223-1dbe-451f-8051-bfb3829cbdd8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.496954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f223-1dbe-451f-8051-bfb3829cbdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.545433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f6c0f223-1dbe-451f-8051-bfb3829cbdd8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:28:52.546689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f6c0f223-1dbe-451f-8051-bfb3829cbdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:52.615143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1201/2438] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:28:52.623429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c469-2126-4004-a287-3fcdff413556 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.624013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c469-2126-4004-a287-3fcdff413556 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.624300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c469-2126-4004-a287-3fcdff413556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.646331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4381c469-2126-4004-a287-3fcdff413556 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:28:52.647609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4381c469-2126-4004-a287-3fcdff413556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:52.656107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1238/2439] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:28:52.660290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f223-1dbe-451f-8051-bfb3829cbdd8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:52.670632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f223-1dbe-451f-8051-bfb3829cbdd8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:52.676084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:52.676804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.677162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.677441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.678151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:28:52.678459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:52.680127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:52.692587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1202/2440] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:28:52.696601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381c469-2126-4004-a287-3fcdff413556 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:52.707827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381c469-2126-4004-a287-3fcdff413556 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:52.712500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e7bde-7f91-46d8-8c22-4c412f71caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:52.713214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7bde-7f91-46d8-8c22-4c412f71caa5 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.713502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7bde-7f91-46d8-8c22-4c412f71caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.713779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7bde-7f91-46d8-8c22-4c412f71caa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.715017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e7bde-7f91-46d8-8c22-4c412f71caa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:52.716979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e7bde-7f91-46d8-8c22-4c412f71caa5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:52.758757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1239/2441] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:28:52 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:28:52.760018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:52.770098 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9ba0e-72ac-4769-a486-8f93dc8cf079 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:52.828439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f3e82-6e40-4dc2-be3b-2a7bfbb35234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:52.829170 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f3e82-6e40-4dc2-be3b-2a7bfbb35234 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.829342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f3e82-6e40-4dc2-be3b-2a7bfbb35234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.829628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f3e82-6e40-4dc2-be3b-2a7bfbb35234 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.830295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f3e82-6e40-4dc2-be3b-2a7bfbb35234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:52.832267 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f3e82-6e40-4dc2-be3b-2a7bfbb35234 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:52.855754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1203/2442] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:28:52 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:28:52.859603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e7bde-7f91-46d8-8c22-4c412f71caa5 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:52.870444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e7bde-7f91-46d8-8c22-4c412f71caa5 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:52.875212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212eba8-1092-451b-9dfd-b467df2e4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:52.875827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212eba8-1092-451b-9dfd-b467df2e4333 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.876111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212eba8-1092-451b-9dfd-b467df2e4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.876415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212eba8-1092-451b-9dfd-b467df2e4333 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.877192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212eba8-1092-451b-9dfd-b467df2e4333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:52.878802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212eba8-1092-451b-9dfd-b467df2e4333 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:52.892652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1240/2443] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:28:52.893871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f3e82-6e40-4dc2-be3b-2a7bfbb35234 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:52.904480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f3e82-6e40-4dc2-be3b-2a7bfbb35234 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:52.909242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8fb87-2782-4fc8-9171-f7209c4c3c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:52.909859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fb87-2782-4fc8-9171-f7209c4c3c5a admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.910147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fb87-2782-4fc8-9171-f7209c4c3c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.910426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8fb87-2782-4fc8-9171-f7209c4c3c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.911155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8fb87-2782-4fc8-9171-f7209c4c3c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:52.912762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8fb87-2782-4fc8-9171-f7209c4c3c5a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:52.914074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:28:52.925278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1204/2444] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:28:52.929417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212eba8-1092-451b-9dfd-b467df2e4333 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:52.939568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212eba8-1092-451b-9dfd-b467df2e4333 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:52.944160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76905fbe-832f-452a-a8ec-bf7b6e8c87d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:52.944817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76905fbe-832f-452a-a8ec-bf7b6e8c87d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.945102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76905fbe-832f-452a-a8ec-bf7b6e8c87d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.945386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76905fbe-832f-452a-a8ec-bf7b6e8c87d2 admin admin] PATH_INFO: `/v3/projects/d924b3bb30414084807beec72938b2cd/users/d165445067fa4ac4af3b9f21564815e8/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:52.961230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76905fbe-832f-452a-a8ec-bf7b6e8c87d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d924b3bb30414084807beec72938b2cd, user_id=d165445067fa4ac4af3b9f21564815e8, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:52.964545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76905fbe-832f-452a-a8ec-bf7b6e8c87d2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:52.977726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1241/2445] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:28:52 2022] PUT /identity/v3/projects/d924b3bb30414084807beec72938b2cd/users/d165445067fa4ac4af3b9f21564815e8/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:28:52.987774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762a3e-28a6-4b49-86b5-67188971b3e3 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:52.988609 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762a3e-28a6-4b49-86b5-67188971b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:52.988902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762a3e-28a6-4b49-86b5-67188971b3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.018960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-94762a3e-28a6-4b49-86b5-67188971b3e3 None None] MFA Rules not processed for user `d165445067fa4ac4af3b9f21564815e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:28:53.020243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-94762a3e-28a6-4b49-86b5-67188971b3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:53.092921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1205/2446] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:28:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:28:53.094577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76905fbe-832f-452a-a8ec-bf7b6e8c87d2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:53.158694 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76905fbe-832f-452a-a8ec-bf7b6e8c87d2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:53.163428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28f40-539e-4a7e-8760-15e197820be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:53.164052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28f40-539e-4a7e-8760-15e197820be1 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.164337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28f40-539e-4a7e-8760-15e197820be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.164613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28f40-539e-4a7e-8760-15e197820be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.165358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f28f40-539e-4a7e-8760-15e197820be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:53.167402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f28f40-539e-4a7e-8760-15e197820be1 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:53.207752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1242/2447] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:28:53 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:28:53.209323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94762a3e-28a6-4b49-86b5-67188971b3e3 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:53.226490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94762a3e-28a6-4b49-86b5-67188971b3e3 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:53.320317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b052-ebfa-49da-926a-32aa089c1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:53.321093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b052-ebfa-49da-926a-32aa089c1ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.321514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b052-ebfa-49da-926a-32aa089c1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.322268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b052-ebfa-49da-926a-32aa089c1ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.323927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b052-ebfa-49da-926a-32aa089c1ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:53.327766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b052-ebfa-49da-926a-32aa089c1ae2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:53.355308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1206/2448] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:28:53 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:28:53.359127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28f40-539e-4a7e-8760-15e197820be1 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:53.371671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28f40-539e-4a7e-8760-15e197820be1 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:53.379576 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bdb98-8055-4c11-9340-ea2289bd50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:53.380285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bdb98-8055-4c11-9340-ea2289bd50c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.380642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bdb98-8055-4c11-9340-ea2289bd50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.380990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bdb98-8055-4c11-9340-ea2289bd50c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.381913 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bdb98-8055-4c11-9340-ea2289bd50c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:53.384117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bdb98-8055-4c11-9340-ea2289bd50c0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:53.401040 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1243/2449] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:28:53.405053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b052-ebfa-49da-926a-32aa089c1ae2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:53.415676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b052-ebfa-49da-926a-32aa089c1ae2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:53.420578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea975864-9fb3-4c9d-af35-2e7c85243461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:53.421313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975864-9fb3-4c9d-af35-2e7c85243461 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.421663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975864-9fb3-4c9d-af35-2e7c85243461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.422016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975864-9fb3-4c9d-af35-2e7c85243461 admin admin] PATH_INFO: `/v3/projects/59c39ecbab80435280536a3f403f7fdf/users/036d108bf2444200957073691c881a76/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.439444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea975864-9fb3-4c9d-af35-2e7c85243461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c39ecbab80435280536a3f403f7fdf, user_id=036d108bf2444200957073691c881a76, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:53.442086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea975864-9fb3-4c9d-af35-2e7c85243461 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:53.457162 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1207/2450] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:28:53 2022] PUT /identity/v3/projects/59c39ecbab80435280536a3f403f7fdf/users/036d108bf2444200957073691c881a76/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:28:53.460910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bdb98-8055-4c11-9340-ea2289bd50c0 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:53.471226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bdb98-8055-4c11-9340-ea2289bd50c0 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:53.513675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:28:53.534880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce60a9-fbb5-40df-ae11-c00b6be7d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:53.535577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce60a9-fbb5-40df-ae11-c00b6be7d559 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.535863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce60a9-fbb5-40df-ae11-c00b6be7d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.536143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce60a9-fbb5-40df-ae11-c00b6be7d559 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.536846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce60a9-fbb5-40df-ae11-c00b6be7d559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:53.538451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce60a9-fbb5-40df-ae11-c00b6be7d559 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:53.548805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1244/2451] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:28:53.552804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea975864-9fb3-4c9d-af35-2e7c85243461 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:53.564140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea975864-9fb3-4c9d-af35-2e7c85243461 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:53.569083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:53.569816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.570174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.570453 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] PATH_INFO: `/v3/projects/59c39ecbab80435280536a3f403f7fdf/users/036d108bf2444200957073691c881a76/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.572463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c39ecbab80435280536a3f403f7fdf, user_id=036d108bf2444200957073691c881a76, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:53.575769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:53.586271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1208/2452] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:28:53 2022] PUT /identity/v3/projects/59c39ecbab80435280536a3f403f7fdf/users/036d108bf2444200957073691c881a76/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:28:53.597454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591f8a8-8d57-4966-8eea-9cd94a263429 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.597754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591f8a8-8d57-4966-8eea-9cd94a263429 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.598042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591f8a8-8d57-4966-8eea-9cd94a263429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.629603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3591f8a8-8d57-4966-8eea-9cd94a263429 None None] MFA Rules not processed for user `036d108bf2444200957073691c881a76`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:28:53.630846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3591f8a8-8d57-4966-8eea-9cd94a263429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:53.713840 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1245/2453] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:28:53.725451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:53.727375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:28:53.773232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:28:53.790645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ceee91-67f4-443d-bcdc-6b79f93ce704 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:53.795122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2fdc3-249c-46f3-baba-411d7b0765bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:53.795760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2fdc3-249c-46f3-baba-411d7b0765bf service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.796049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2fdc3-249c-46f3-baba-411d7b0765bf service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.796329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2fdc3-249c-46f3-baba-411d7b0765bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.806183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2fdc3-249c-46f3-baba-411d7b0765bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:53.808519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2fdc3-249c-46f3-baba-411d7b0765bf service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:53.819352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1209/2454] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:28:53.911793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591f8a8-8d57-4966-8eea-9cd94a263429 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:28:53.923250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591f8a8-8d57-4966-8eea-9cd94a263429 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:28:53.927208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057576-a404-4073-a816-143ea95f9eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:28:53.927941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057576-a404-4073-a816-143ea95f9eaa service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:28:53.928291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057576-a404-4073-a816-143ea95f9eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:28:53.928646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057576-a404-4073-a816-143ea95f9eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:28:53.988473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057576-a404-4073-a816-143ea95f9eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:28:53.989861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057576-a404-4073-a816-143ea95f9eaa service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:28:53.999369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1246/2455] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:28:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:03.814329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=9 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:03.996090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=72 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:04.861239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2fdc3-249c-46f3-baba-411d7b0765bf service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:04.926590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2fdc3-249c-46f3-baba-411d7b0765bf service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:04.931289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:04.931929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:04.932214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:04.932492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] PATH_INFO: `/v3/users/d165445067fa4ac4af3b9f21564815e8` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:04.939091 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d165445067fa4ac4af3b9f21564815e8)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:04.941081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:04.987328 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd165445067fa4ac4af3b9f21564815e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:04.994003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd165445067fa4ac4af3b9f21564815e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:04.994947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd165445067fa4ac4af3b9f21564815e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.006340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd165445067fa4ac4af3b9f21564815e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.006997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd165445067fa4ac4af3b9f21564815e8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.019875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1210/2456] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:04 2022] DELETE /identity/v3/users/d165445067fa4ac4af3b9f21564815e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:05.024353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0362-94df-442b-8b5e-77795fc9f7ba None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:05.024821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0362-94df-442b-8b5e-77795fc9f7ba None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:05.024949 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0362-94df-442b-8b5e-77795fc9f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:05.045616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c03f0362-94df-442b-8b5e-77795fc9f7ba None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:05.046814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c03f0362-94df-442b-8b5e-77795fc9f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:05.103246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1247/2457] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:05.112915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:05.114332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:05.171387 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1030-26d5-4ddf-8ac3-a237e5473648 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:05.175114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e2545-889e-4b37-b324-38e8f3c19823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:05.175733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e2545-889e-4b37-b324-38e8f3c19823 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:05.176018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e2545-889e-4b37-b324-38e8f3c19823 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:05.176416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e2545-889e-4b37-b324-38e8f3c19823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:05.186885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e2545-889e-4b37-b324-38e8f3c19823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:05.188355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e2545-889e-4b37-b324-38e8f3c19823 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:05.197862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1211/2458] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:05.472797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f0362-94df-442b-8b5e-77795fc9f7ba None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:05.474599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c03f0362-94df-442b-8b5e-77795fc9f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:05.491162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f0362-94df-442b-8b5e-77795fc9f7ba None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:05.498591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:05.499544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:05.499737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:05.500156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] PATH_INFO: `/v3/projects/d924b3bb30414084807beec72938b2cd` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:05.501564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d924b3bb30414084807beec72938b2cd)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:05.503895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:05.556213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd924b3bb30414084807beec72938b2cd', 'request_id': 'req-0c470d3d-a786-48b0-9299-84dd425e0833'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.564787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd924b3bb30414084807beec72938b2cd', 'request_id': 'req-0c470d3d-a786-48b0-9299-84dd425e0833'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.570375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd924b3bb30414084807beec72938b2cd', 'request_id': 'req-0c470d3d-a786-48b0-9299-84dd425e0833'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.582215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] The token cache is being invalidate because project d924b3bb30414084807beec72938b2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:05.582627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.583355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.585202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1248/2459] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:05 2022] DELETE /identity/v3/projects/d924b3bb30414084807beec72938b2cd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:05.589403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e2545-889e-4b37-b324-38e8f3c19823 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:05.601643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e2545-889e-4b37-b324-38e8f3c19823 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:05.627620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:05.678451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:05.679142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:05.679431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:05.679743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] PATH_INFO: `/v3/users/036d108bf2444200957073691c881a76` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:05.681023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036d108bf2444200957073691c881a76)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:05.683629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:05.731804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036d108bf2444200957073691c881a76'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.738683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036d108bf2444200957073691c881a76'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.739361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036d108bf2444200957073691c881a76'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.751913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036d108bf2444200957073691c881a76'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.752547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4c7a4351-1885-46e2-a93f-dc0a0ff30292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036d108bf2444200957073691c881a76'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:05.765616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1212/2460] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:05 2022] DELETE /identity/v3/users/036d108bf2444200957073691c881a76 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:06.057691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.059204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:06.072313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c470d3d-a786-48b0-9299-84dd425e0833 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.131954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.132852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.133212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.133524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] PATH_INFO: `/v3/projects/59c39ecbab80435280536a3f403f7fdf` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.134962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c39ecbab80435280536a3f403f7fdf)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.136914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.167865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:06.184756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c39ecbab80435280536a3f403f7fdf', 'request_id': 'req-91d424ea-6ce1-427d-8801-32b380e4d3f4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:06.192008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c39ecbab80435280536a3f403f7fdf', 'request_id': 'req-91d424ea-6ce1-427d-8801-32b380e4d3f4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:06.197580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c39ecbab80435280536a3f403f7fdf', 'request_id': 'req-91d424ea-6ce1-427d-8801-32b380e4d3f4'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:06.209634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] The token cache is being invalidate because project 59c39ecbab80435280536a3f403f7fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:06.209928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:06.210573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-91d424ea-6ce1-427d-8801-32b380e4d3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:06.212110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1249/2461] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:06 2022] DELETE /identity/v3/projects/59c39ecbab80435280536a3f403f7fdf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:06.217399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3cd8-6a25-44d2-a0d0-b28c81b080bc None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.217895 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3cd8-6a25-44d2-a0d0-b28c81b080bc None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.218018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3cd8-6a25-44d2-a0d0-b28c81b080bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.237712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ec4d3cd8-6a25-44d2-a0d0-b28c81b080bc None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:06.238906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ec4d3cd8-6a25-44d2-a0d0-b28c81b080bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:06.297488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1213/2462] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:06.305103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31252-a35c-4cab-8cda-475efa7b0922 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.305392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31252-a35c-4cab-8cda-475efa7b0922 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.305674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31252-a35c-4cab-8cda-475efa7b0922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.325653 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-44c31252-a35c-4cab-8cda-475efa7b0922 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:06.326896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-44c31252-a35c-4cab-8cda-475efa7b0922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:06.335587 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1250/2463] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:06.340303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d3cd8-6a25-44d2-a0d0-b28c81b080bc None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.349985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d3cd8-6a25-44d2-a0d0-b28c81b080bc None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.354856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.355497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.355909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.356079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.356770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:29:06.357073 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.358668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.370269 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1214/2464] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 08:29:06.374992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31252-a35c-4cab-8cda-475efa7b0922 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.383577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31252-a35c-4cab-8cda-475efa7b0922 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.388808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe04030-5881-409a-9421-93b4d66a57a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.389412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04030-5881-409a-9421-93b4d66a57a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.389746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04030-5881-409a-9421-93b4d66a57a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.390025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04030-5881-409a-9421-93b4d66a57a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.390685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe04030-5881-409a-9421-93b4d66a57a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.392609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe04030-5881-409a-9421-93b4d66a57a6 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.419620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1251/2465] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:06 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:06.423719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.433693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bc4c7-7f8f-480e-83b1-3baf3ba394df admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.459019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:06.490726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f130fef-d278-4701-9027-62a4f853f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.491374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f130fef-d278-4701-9027-62a4f853f670 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.491659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f130fef-d278-4701-9027-62a4f853f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.491935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f130fef-d278-4701-9027-62a4f853f670 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.492605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f130fef-d278-4701-9027-62a4f853f670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.494553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f130fef-d278-4701-9027-62a4f853f670 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.516075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1215/2466] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:06 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:06.520080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe04030-5881-409a-9421-93b4d66a57a6 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.530953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe04030-5881-409a-9421-93b4d66a57a6 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.535787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7a26-e2e3-478c-a5e0-e4ce88b9fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.536388 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7a26-e2e3-478c-a5e0-e4ce88b9fb18 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.536663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7a26-e2e3-478c-a5e0-e4ce88b9fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.536933 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7a26-e2e3-478c-a5e0-e4ce88b9fb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.537622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7a26-e2e3-478c-a5e0-e4ce88b9fb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.539278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7a26-e2e3-478c-a5e0-e4ce88b9fb18 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.549251 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1252/2467] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:06.553278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f130fef-d278-4701-9027-62a4f853f670 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.563638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f130fef-d278-4701-9027-62a4f853f670 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.568295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ebac9-64fc-40cb-8ca3-e8e12cbc0b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.568906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebac9-64fc-40cb-8ca3-e8e12cbc0b5b admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.569191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebac9-64fc-40cb-8ca3-e8e12cbc0b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.569471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebac9-64fc-40cb-8ca3-e8e12cbc0b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.570172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebac9-64fc-40cb-8ca3-e8e12cbc0b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.571801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebac9-64fc-40cb-8ca3-e8e12cbc0b5b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.582740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1216/2468] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:06.586644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7a26-e2e3-478c-a5e0-e4ce88b9fb18 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.597174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7a26-e2e3-478c-a5e0-e4ce88b9fb18 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.601855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af930f-0340-427e-8f5d-bdf25efcedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.602503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af930f-0340-427e-8f5d-bdf25efcedfc admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.602782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af930f-0340-427e-8f5d-bdf25efcedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.603097 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af930f-0340-427e-8f5d-bdf25efcedfc admin admin] PATH_INFO: `/v3/projects/5a66dc8660fb4b26a586f79631f2e03d/users/f284deaf28f3497cbbec1182ef51509d/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.617175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af930f-0340-427e-8f5d-bdf25efcedfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a66dc8660fb4b26a586f79631f2e03d, user_id=f284deaf28f3497cbbec1182ef51509d, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.620083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af930f-0340-427e-8f5d-bdf25efcedfc admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.632832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1253/2469] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:06 2022] PUT /identity/v3/projects/5a66dc8660fb4b26a586f79631f2e03d/users/f284deaf28f3497cbbec1182ef51509d/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:06.644477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267f558-1f24-4175-94b5-5650ead7042a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.644843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267f558-1f24-4175-94b5-5650ead7042a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.645129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267f558-1f24-4175-94b5-5650ead7042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.672432 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1267f558-1f24-4175-94b5-5650ead7042a None None] MFA Rules not processed for user `f284deaf28f3497cbbec1182ef51509d`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:06.673647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1267f558-1f24-4175-94b5-5650ead7042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:06.738412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1217/2470] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:06.742787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af930f-0340-427e-8f5d-bdf25efcedfc admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.803249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af930f-0340-427e-8f5d-bdf25efcedfc admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.809545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330039db-1d2e-468a-b8d7-663c232a9983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.810154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330039db-1d2e-468a-b8d7-663c232a9983 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.810434 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330039db-1d2e-468a-b8d7-663c232a9983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.810705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330039db-1d2e-468a-b8d7-663c232a9983 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.811401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330039db-1d2e-468a-b8d7-663c232a9983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.813301 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330039db-1d2e-468a-b8d7-663c232a9983 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.839738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1254/2471] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:06 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:06.844271 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267f558-1f24-4175-94b5-5650ead7042a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.855165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267f558-1f24-4175-94b5-5650ead7042a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.910899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c0f6-07b3-4b2f-a86b-10399152e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.911542 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c0f6-07b3-4b2f-a86b-10399152e0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.911822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c0f6-07b3-4b2f-a86b-10399152e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.912094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c0f6-07b3-4b2f-a86b-10399152e0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.912761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068c0f6-07b3-4b2f-a86b-10399152e0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.914662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068c0f6-07b3-4b2f-a86b-10399152e0d2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.935219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1218/2472] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:06 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:29:06.939145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330039db-1d2e-468a-b8d7-663c232a9983 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.949915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330039db-1d2e-468a-b8d7-663c232a9983 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.954819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea4068-5889-4ad7-bf5e-0226aaa9e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.955477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea4068-5889-4ad7-bf5e-0226aaa9e211 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.955754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea4068-5889-4ad7-bf5e-0226aaa9e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.956025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea4068-5889-4ad7-bf5e-0226aaa9e211 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:06.956717 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea4068-5889-4ad7-bf5e-0226aaa9e211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:06.966665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea4068-5889-4ad7-bf5e-0226aaa9e211 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:06.977897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1255/2473] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:06.982180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c0f6-07b3-4b2f-a86b-10399152e0d2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:06.992420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c0f6-07b3-4b2f-a86b-10399152e0d2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:06.998477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a09b-253b-45cd-91c0-de20956151a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:06.999181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a09b-253b-45cd-91c0-de20956151a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:06.999461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a09b-253b-45cd-91c0-de20956151a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:06.999732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a09b-253b-45cd-91c0-de20956151a6 admin admin] PATH_INFO: `/v3/projects/4e61a7706fb64fce86d3823e5739067c/users/aef8089809b5464fac3dabfb18bb0d9e/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:07.015288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690a09b-253b-45cd-91c0-de20956151a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e61a7706fb64fce86d3823e5739067c, user_id=aef8089809b5464fac3dabfb18bb0d9e, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:07.017933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690a09b-253b-45cd-91c0-de20956151a6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:07.031739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1219/2474] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:06 2022] PUT /identity/v3/projects/4e61a7706fb64fce86d3823e5739067c/users/aef8089809b5464fac3dabfb18bb0d9e/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:29:07.035962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea4068-5889-4ad7-bf5e-0226aaa9e211 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:07.046124 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea4068-5889-4ad7-bf5e-0226aaa9e211 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:07.065946 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:07.104395 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23451af9-a94b-450d-beba-7323e52eb2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:07.105544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451af9-a94b-450d-beba-7323e52eb2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:07.105826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451af9-a94b-450d-beba-7323e52eb2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:07.106103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23451af9-a94b-450d-beba-7323e52eb2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:07.106800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23451af9-a94b-450d-beba-7323e52eb2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:07.108431 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23451af9-a94b-450d-beba-7323e52eb2e9 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:07.118023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1256/2475] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:07.123067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a09b-253b-45cd-91c0-de20956151a6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:07.128533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:07.134694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a09b-253b-45cd-91c0-de20956151a6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:07.139809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:07.140508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:07.140794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:07.141082 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] PATH_INFO: `/v3/projects/4e61a7706fb64fce86d3823e5739067c/users/aef8089809b5464fac3dabfb18bb0d9e/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:07.143123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e61a7706fb64fce86d3823e5739067c, user_id=aef8089809b5464fac3dabfb18bb0d9e, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:07.145758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:07.155908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1220/2476] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:07 2022] PUT /identity/v3/projects/4e61a7706fb64fce86d3823e5739067c/users/aef8089809b5464fac3dabfb18bb0d9e/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:07.166095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b1a4a-ad17-4f2c-8fe3-0cdb2197dec1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:07.166387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b1a4a-ad17-4f2c-8fe3-0cdb2197dec1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:07.166672 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b1a4a-ad17-4f2c-8fe3-0cdb2197dec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:07.195026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-128b1a4a-ad17-4f2c-8fe3-0cdb2197dec1 None None] MFA Rules not processed for user `aef8089809b5464fac3dabfb18bb0d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:07.196237 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-128b1a4a-ad17-4f2c-8fe3-0cdb2197dec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:07.265781 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1257/2477] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:07.276962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:07.278708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:07.334815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2331fa-bcbe-4306-a75f-c0ea545af9e2 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:07.338366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3673-5768-4382-b213-5a0f9529c5b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:07.339045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3673-5768-4382-b213-5a0f9529c5b0 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:07.339330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3673-5768-4382-b213-5a0f9529c5b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:07.339605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3673-5768-4382-b213-5a0f9529c5b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:07.348331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3673-5768-4382-b213-5a0f9529c5b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:07.349740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3673-5768-4382-b213-5a0f9529c5b0 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:07.359418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1221/2478] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:07.761858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b1a4a-ad17-4f2c-8fe3-0cdb2197dec1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:07.824228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b1a4a-ad17-4f2c-8fe3-0cdb2197dec1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:07.828688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:07.829322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:07.829601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:07.829873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] PATH_INFO: `/v3/users/f284deaf28f3497cbbec1182ef51509d` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:07.831043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f284deaf28f3497cbbec1182ef51509d)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:07.832965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:07.877510 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f284deaf28f3497cbbec1182ef51509d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:07.879150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:07.885118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f284deaf28f3497cbbec1182ef51509d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:07.892764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f284deaf28f3497cbbec1182ef51509d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:07.893385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f284deaf28f3497cbbec1182ef51509d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:07.905568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f284deaf28f3497cbbec1182ef51509d'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:07.911292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1258/2479] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:07 2022] DELETE /identity/v3/users/f284deaf28f3497cbbec1182ef51509d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:07.915933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0341-6577-406f-a325-3a60b4cc71e8 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:07.916223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0341-6577-406f-a325-3a60b4cc71e8 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:07.916501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0341-6577-406f-a325-3a60b4cc71e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:07.934622 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-6bbb0341-6577-406f-a325-3a60b4cc71e8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:07.935843 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6bbb0341-6577-406f-a325-3a60b4cc71e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:07.993574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1222/2480] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:29:08.003396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:08.004772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:08.064281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c563f-2242-4ce3-9757-49ca7c599929 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:08.067928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdd9d2-ff90-445b-9220-1297da0121a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:08.068544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdd9d2-ff90-445b-9220-1297da0121a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:08.068813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdd9d2-ff90-445b-9220-1297da0121a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:08.069090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdd9d2-ff90-445b-9220-1297da0121a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:08.078632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdd9d2-ff90-445b-9220-1297da0121a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:08.080188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdd9d2-ff90-445b-9220-1297da0121a0 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:08.090616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1259/2481] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:08.355913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0341-6577-406f-a325-3a60b4cc71e8 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:08.357363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6bbb0341-6577-406f-a325-3a60b4cc71e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:08.369521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0341-6577-406f-a325-3a60b4cc71e8 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:08.375142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:08.375862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:08.376216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:08.376560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] PATH_INFO: `/v3/projects/5a66dc8660fb4b26a586f79631f2e03d` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:08.377796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a66dc8660fb4b26a586f79631f2e03d)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:08.379985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:08.426397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a66dc8660fb4b26a586f79631f2e03d', 'request_id': 'req-b6756a40-ecb4-4cbd-bb06-412338557134'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.433355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a66dc8660fb4b26a586f79631f2e03d', 'request_id': 'req-b6756a40-ecb4-4cbd-bb06-412338557134'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.440604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a66dc8660fb4b26a586f79631f2e03d', 'request_id': 'req-b6756a40-ecb4-4cbd-bb06-412338557134'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.451319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] The token cache is being invalidate because project 5a66dc8660fb4b26a586f79631f2e03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:08.451604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.452224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.453722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1223/2482] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:08 2022] DELETE /identity/v3/projects/5a66dc8660fb4b26a586f79631f2e03d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:08.457635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdd9d2-ff90-445b-9220-1297da0121a0 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:08.467295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdd9d2-ff90-445b-9220-1297da0121a0 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:08.522844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:08.523505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:08.523783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:08.524056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] PATH_INFO: `/v3/users/aef8089809b5464fac3dabfb18bb0d9e` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:08.525206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef8089809b5464fac3dabfb18bb0d9e)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:08.527136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:08.575364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef8089809b5464fac3dabfb18bb0d9e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.590470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef8089809b5464fac3dabfb18bb0d9e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.597514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef8089809b5464fac3dabfb18bb0d9e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.598240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef8089809b5464fac3dabfb18bb0d9e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.603507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:08.612331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-07c4919a-2491-4a65-a2c3-cbc622bc0fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef8089809b5464fac3dabfb18bb0d9e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:08.618529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1260/2483] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:08 2022] DELETE /identity/v3/users/aef8089809b5464fac3dabfb18bb0d9e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:08.888261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:08.889742 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:08.904456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756a40-ecb4-4cbd-bb06-412338557134 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:08.924551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:08.972037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:08.972675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:08.972956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:08.973230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] PATH_INFO: `/v3/projects/4e61a7706fb64fce86d3823e5739067c` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:08.974381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e61a7706fb64fce86d3823e5739067c)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:08.976326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.021173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e61a7706fb64fce86d3823e5739067c', 'request_id': 'req-cfc740e9-f206-4cf7-a187-abd9599ab595'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:09.027810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e61a7706fb64fce86d3823e5739067c', 'request_id': 'req-cfc740e9-f206-4cf7-a187-abd9599ab595'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:09.035196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e61a7706fb64fce86d3823e5739067c', 'request_id': 'req-cfc740e9-f206-4cf7-a187-abd9599ab595'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:09.046067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] The token cache is being invalidate because project 4e61a7706fb64fce86d3823e5739067c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:09.046359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:09.047022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-cfc740e9-f206-4cf7-a187-abd9599ab595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:09.048508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1224/2484] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:08 2022] DELETE /identity/v3/projects/4e61a7706fb64fce86d3823e5739067c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:09.053360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab4b4-6a2c-46fd-9191-a69c3f2e120c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.053649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab4b4-6a2c-46fd-9191-a69c3f2e120c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.053940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab4b4-6a2c-46fd-9191-a69c3f2e120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.073346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5b5ab4b4-6a2c-46fd-9191-a69c3f2e120c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:09.074557 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5b5ab4b4-6a2c-46fd-9191-a69c3f2e120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:09.136239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1261/2485] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:09.144562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a2d5-8d06-4c2b-927c-52668a45831d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.144923 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a2d5-8d06-4c2b-927c-52668a45831d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.145206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a2d5-8d06-4c2b-927c-52668a45831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.165240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b0d2a2d5-8d06-4c2b-927c-52668a45831d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:09.166460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b0d2a2d5-8d06-4c2b-927c-52668a45831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:09.174921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1225/2486] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:09.179295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ab4b4-6a2c-46fd-9191-a69c3f2e120c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.189099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ab4b4-6a2c-46fd-9191-a69c3f2e120c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.193630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.194246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.194528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.194802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.195531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:29:09.195837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.197423 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.208981 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1262/2487] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:29:09.213244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2a2d5-8d06-4c2b-927c-52668a45831d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.222838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2a2d5-8d06-4c2b-927c-52668a45831d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.227467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfa2e-ebeb-4994-b2d0-376425a7cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.228065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfa2e-ebeb-4994-b2d0-376425a7cefd admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.228344 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfa2e-ebeb-4994-b2d0-376425a7cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.228617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfa2e-ebeb-4994-b2d0-376425a7cefd admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.229318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfa2e-ebeb-4994-b2d0-376425a7cefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.231856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfa2e-ebeb-4994-b2d0-376425a7cefd admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.258325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1226/2488] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:09 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:09.262368 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.272189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f19a98-6022-425e-8101-079ac52143d2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.328428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157fbb1-4a98-400f-b4d4-68d51a834388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.329201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157fbb1-4a98-400f-b4d4-68d51a834388 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.329479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157fbb1-4a98-400f-b4d4-68d51a834388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.329749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157fbb1-4a98-400f-b4d4-68d51a834388 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.330404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157fbb1-4a98-400f-b4d4-68d51a834388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.332339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157fbb1-4a98-400f-b4d4-68d51a834388 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.353995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1263/2489] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:09 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:09.358156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfa2e-ebeb-4994-b2d0-376425a7cefd admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.368415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfa2e-ebeb-4994-b2d0-376425a7cefd admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.373198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a48ce8-437c-4e51-a5a9-5917219502b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.373797 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48ce8-437c-4e51-a5a9-5917219502b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.374077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48ce8-437c-4e51-a5a9-5917219502b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.374349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48ce8-437c-4e51-a5a9-5917219502b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.375071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a48ce8-437c-4e51-a5a9-5917219502b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.376653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a48ce8-437c-4e51-a5a9-5917219502b7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.386830 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1227/2490] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:09.390497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157fbb1-4a98-400f-b4d4-68d51a834388 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.400461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157fbb1-4a98-400f-b4d4-68d51a834388 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.405689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de191f9f-bfc3-4f90-a2bc-61397c3ffd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.406294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de191f9f-bfc3-4f90-a2bc-61397c3ffd9d admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.406573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de191f9f-bfc3-4f90-a2bc-61397c3ffd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.406846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de191f9f-bfc3-4f90-a2bc-61397c3ffd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.407570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de191f9f-bfc3-4f90-a2bc-61397c3ffd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.409136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de191f9f-bfc3-4f90-a2bc-61397c3ffd9d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.419756 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1264/2491] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:09.423366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a48ce8-437c-4e51-a5a9-5917219502b7 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.433045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a48ce8-437c-4e51-a5a9-5917219502b7 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.437615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5d32f-b5e5-443d-bb8d-e4959ef42d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.438254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d32f-b5e5-443d-bb8d-e4959ef42d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.438533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d32f-b5e5-443d-bb8d-e4959ef42d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.438810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d32f-b5e5-443d-bb8d-e4959ef42d40 admin admin] PATH_INFO: `/v3/projects/89a797a810a04508b7bfcd1718045ccd/users/2ba0efdbad734974910855a1c3417a7f/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.453731 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5d32f-b5e5-443d-bb8d-e4959ef42d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a797a810a04508b7bfcd1718045ccd, user_id=2ba0efdbad734974910855a1c3417a7f, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.456496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5d32f-b5e5-443d-bb8d-e4959ef42d40 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.471820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1228/2492] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:09 2022] PUT /identity/v3/projects/89a797a810a04508b7bfcd1718045ccd/users/2ba0efdbad734974910855a1c3417a7f/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:09.483009 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8926a8-05a6-46d2-a951-820ef418758d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.483324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8926a8-05a6-46d2-a951-820ef418758d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.483603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8926a8-05a6-46d2-a951-820ef418758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.512697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4b8926a8-05a6-46d2-a951-820ef418758d None None] MFA Rules not processed for user `2ba0efdbad734974910855a1c3417a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:09.513889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4b8926a8-05a6-46d2-a951-820ef418758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:09.554371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:09.577851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1265/2493] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:09.582270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5d32f-b5e5-443d-bb8d-e4959ef42d40 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.626756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:09.646202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5d32f-b5e5-443d-bb8d-e4959ef42d40 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.650848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde4e95-0d85-470d-b467-a3a75b4f403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.652107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4e95-0d85-470d-b467-a3a75b4f403f admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.652395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4e95-0d85-470d-b467-a3a75b4f403f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.652675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4e95-0d85-470d-b467-a3a75b4f403f admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.653367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde4e95-0d85-470d-b467-a3a75b4f403f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.655325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde4e95-0d85-470d-b467-a3a75b4f403f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.681782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1229/2494] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:09 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:29:09.686760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8926a8-05a6-46d2-a951-820ef418758d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.697344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8926a8-05a6-46d2-a951-820ef418758d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.754547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77657a1-c16a-4841-a602-afbfac90590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.755196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77657a1-c16a-4841-a602-afbfac90590d admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.755477 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77657a1-c16a-4841-a602-afbfac90590d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.755750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77657a1-c16a-4841-a602-afbfac90590d admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.756418 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77657a1-c16a-4841-a602-afbfac90590d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.758335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77657a1-c16a-4841-a602-afbfac90590d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.779500 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1266/2495] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:09 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:09.783604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde4e95-0d85-470d-b467-a3a75b4f403f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.794009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde4e95-0d85-470d-b467-a3a75b4f403f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.798709 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb1bc-3fd3-4640-8c41-dfdce9a038be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.799358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb1bc-3fd3-4640-8c41-dfdce9a038be admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.799646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb1bc-3fd3-4640-8c41-dfdce9a038be admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.799926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deb1bc-3fd3-4640-8c41-dfdce9a038be admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.800631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deb1bc-3fd3-4640-8c41-dfdce9a038be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.802230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deb1bc-3fd3-4640-8c41-dfdce9a038be admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.814340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1230/2496] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:09.818639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77657a1-c16a-4841-a602-afbfac90590d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.829269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77657a1-c16a-4841-a602-afbfac90590d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.833942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d0c8d-bbf2-4366-8f74-6960c0d762a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.834632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0c8d-bbf2-4366-8f74-6960c0d762a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.834915 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0c8d-bbf2-4366-8f74-6960c0d762a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.835224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d0c8d-bbf2-4366-8f74-6960c0d762a1 admin admin] PATH_INFO: `/v3/projects/7c50bf68c85946bfb3673259b63b60f2/users/54b65bd4b9bb46848d19c589a6fa46f1/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.854157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d0c8d-bbf2-4366-8f74-6960c0d762a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c50bf68c85946bfb3673259b63b60f2, user_id=54b65bd4b9bb46848d19c589a6fa46f1, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.856897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d0c8d-bbf2-4366-8f74-6960c0d762a1 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.872398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1267/2497] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:09 2022] PUT /identity/v3/projects/7c50bf68c85946bfb3673259b63b60f2/users/54b65bd4b9bb46848d19c589a6fa46f1/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:09.876558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb1bc-3fd3-4640-8c41-dfdce9a038be admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.887702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deb1bc-3fd3-4640-8c41-dfdce9a038be admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.944065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ab83-bde6-486e-a184-29e7044d7658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.944681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ab83-bde6-486e-a184-29e7044d7658 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.944961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ab83-bde6-486e-a184-29e7044d7658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.945261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ab83-bde6-486e-a184-29e7044d7658 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.945959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ab83-bde6-486e-a184-29e7044d7658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.947663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ab83-bde6-486e-a184-29e7044d7658 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.957973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1231/2498] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:09.962109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d0c8d-bbf2-4366-8f74-6960c0d762a1 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:09.972429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d0c8d-bbf2-4366-8f74-6960c0d762a1 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:09.977078 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:09.977737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:09.978024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:09.978306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] PATH_INFO: `/v3/projects/7c50bf68c85946bfb3673259b63b60f2/users/54b65bd4b9bb46848d19c589a6fa46f1/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:09.980327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c50bf68c85946bfb3673259b63b60f2, user_id=54b65bd4b9bb46848d19c589a6fa46f1, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:09.982974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:09.992912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1268/2499] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:09 2022] PUT /identity/v3/projects/7c50bf68c85946bfb3673259b63b60f2/users/54b65bd4b9bb46848d19c589a6fa46f1/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:10.003575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc2a38-2970-4f92-86a9-c535b78c344b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:10.003867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc2a38-2970-4f92-86a9-c535b78c344b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:10.004146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc2a38-2970-4f92-86a9-c535b78c344b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:10.031497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-72bc2a38-2970-4f92-86a9-c535b78c344b None None] MFA Rules not processed for user `54b65bd4b9bb46848d19c589a6fa46f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:10.032708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-72bc2a38-2970-4f92-86a9-c535b78c344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:10.102762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1232/2500] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:10.115326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:10.116766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:10.181849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda7298-92df-40e0-9c03-a0c6c9de69bd admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:10.186589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a6984-2a6e-48ec-959c-b458a0446f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:10.187751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6984-2a6e-48ec-959c-b458a0446f10 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:10.187751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6984-2a6e-48ec-959c-b458a0446f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:10.187980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a6984-2a6e-48ec-959c-b458a0446f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:10.198737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a6984-2a6e-48ec-959c-b458a0446f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:10.200221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a6984-2a6e-48ec-959c-b458a0446f10 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:10.210137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1269/2501] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:10.282515 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc2a38-2970-4f92-86a9-c535b78c344b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:10.292526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc2a38-2970-4f92-86a9-c535b78c344b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:10.296143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b24e9a-7873-4423-8782-1b6891762bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:10.296753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24e9a-7873-4423-8782-1b6891762bbb service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:10.297033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24e9a-7873-4423-8782-1b6891762bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:10.297307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24e9a-7873-4423-8782-1b6891762bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:10.330585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:10.355068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b24e9a-7873-4423-8782-1b6891762bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:10.356497 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b24e9a-7873-4423-8782-1b6891762bbb service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:10.365212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1233/2502] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:13.072035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a6984-2a6e-48ec-959c-b458a0446f10 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:13.115345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:13.138568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a6984-2a6e-48ec-959c-b458a0446f10 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:13.143519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:13.144169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:13.144452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:13.144734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] PATH_INFO: `/v3/users/2ba0efdbad734974910855a1c3417a7f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:13.145911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba0efdbad734974910855a1c3417a7f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:13.148020 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:13.197119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba0efdbad734974910855a1c3417a7f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.205118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba0efdbad734974910855a1c3417a7f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.213563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba0efdbad734974910855a1c3417a7f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.216522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba0efdbad734974910855a1c3417a7f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.234119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba0efdbad734974910855a1c3417a7f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.237446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1270/2503] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:13 2022] DELETE /identity/v3/users/2ba0efdbad734974910855a1c3417a7f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:13.241783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2f6d-f624-41f4-b3fc-60e6dbc91edc None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:13.242238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2f6d-f624-41f4-b3fc-60e6dbc91edc None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:13.242380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2f6d-f624-41f4-b3fc-60e6dbc91edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:13.263489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-62af2f6d-f624-41f4-b3fc-60e6dbc91edc None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:13.264940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-62af2f6d-f624-41f4-b3fc-60e6dbc91edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:13.327403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1234/2504] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:13.337201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:13.339516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:13.398682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a6204-4c43-4f57-83b8-176a6dbe9de2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:13.402978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a4f1c-44c4-4ab6-9d92-8befc255e032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:13.403631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a4f1c-44c4-4ab6-9d92-8befc255e032 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:13.403912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a4f1c-44c4-4ab6-9d92-8befc255e032 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:13.404189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a4f1c-44c4-4ab6-9d92-8befc255e032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:13.413121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a4f1c-44c4-4ab6-9d92-8befc255e032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:13.414548 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a4f1c-44c4-4ab6-9d92-8befc255e032 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:13.424277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1271/2505] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:13.687967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af2f6d-f624-41f4-b3fc-60e6dbc91edc None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:13.689482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-62af2f6d-f624-41f4-b3fc-60e6dbc91edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:13.702221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af2f6d-f624-41f4-b3fc-60e6dbc91edc None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:13.707097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:13.707881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:13.708236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:13.708512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] PATH_INFO: `/v3/projects/89a797a810a04508b7bfcd1718045ccd` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:13.709690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a797a810a04508b7bfcd1718045ccd)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:13.711670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:13.759045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a797a810a04508b7bfcd1718045ccd', 'request_id': 'req-9f896174-f610-4a97-ad72-7a275955a230'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.765124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a797a810a04508b7bfcd1718045ccd', 'request_id': 'req-9f896174-f610-4a97-ad72-7a275955a230'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.772433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a797a810a04508b7bfcd1718045ccd', 'request_id': 'req-9f896174-f610-4a97-ad72-7a275955a230'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.783084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] The token cache is being invalidate because project 89a797a810a04508b7bfcd1718045ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:13.783376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.784016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.785531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1235/2506] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:13 2022] DELETE /identity/v3/projects/89a797a810a04508b7bfcd1718045ccd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:13.789454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a4f1c-44c4-4ab6-9d92-8befc255e032 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:13.799746 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a4f1c-44c4-4ab6-9d92-8befc255e032 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:13.859534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:13.860188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:13.860476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:13.860757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] PATH_INFO: `/v3/users/54b65bd4b9bb46848d19c589a6fa46f1` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:13.861941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b65bd4b9bb46848d19c589a6fa46f1)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:13.863924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:13.865436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:13.912094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b65bd4b9bb46848d19c589a6fa46f1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.919074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b65bd4b9bb46848d19c589a6fa46f1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.926002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b65bd4b9bb46848d19c589a6fa46f1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.926650 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b65bd4b9bb46848d19c589a6fa46f1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.938496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d4bbc2ac-74ae-460d-8e45-5c88b2029dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b65bd4b9bb46848d19c589a6fa46f1'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:13.944794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1272/2507] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:13 2022] DELETE /identity/v3/users/54b65bd4b9bb46848d19c589a6fa46f1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:14.220521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:14.222104 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:14.235996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f896174-f610-4a97-ad72-7a275955a230 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:14.303261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:14.303861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.304117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.304409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] PATH_INFO: `/v3/projects/7c50bf68c85946bfb3673259b63b60f2` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.305546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c50bf68c85946bfb3673259b63b60f2)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:14.307964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:14.309391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:14.357408 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c50bf68c85946bfb3673259b63b60f2', 'request_id': 'req-9c5361b3-8cc2-4221-b730-48ce86149095'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:14.364026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c50bf68c85946bfb3673259b63b60f2', 'request_id': 'req-9c5361b3-8cc2-4221-b730-48ce86149095'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:14.373772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c50bf68c85946bfb3673259b63b60f2', 'request_id': 'req-9c5361b3-8cc2-4221-b730-48ce86149095'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:14.384805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] The token cache is being invalidate because project 7c50bf68c85946bfb3673259b63b60f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:14.385102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:14.386299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9c5361b3-8cc2-4221-b730-48ce86149095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:14.388106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1236/2508] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:14 2022] DELETE /identity/v3/projects/7c50bf68c85946bfb3673259b63b60f2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:14.392923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b7e6-da21-4286-ba29-028179e334b0 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.393413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b7e6-da21-4286-ba29-028179e334b0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.393532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4b7e6-da21-4286-ba29-028179e334b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.414046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-bec4b7e6-da21-4286-ba29-028179e334b0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:14.415280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bec4b7e6-da21-4286-ba29-028179e334b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:14.472307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1273/2509] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:29:14.481191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f4570-fc06-4113-9fc7-1ff64f8d800b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.481484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f4570-fc06-4113-9fc7-1ff64f8d800b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.481766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f4570-fc06-4113-9fc7-1ff64f8d800b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.501700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-891f4570-fc06-4113-9fc7-1ff64f8d800b None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:14.502917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-891f4570-fc06-4113-9fc7-1ff64f8d800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:14.511476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1237/2510] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:14.515486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4b7e6-da21-4286-ba29-028179e334b0 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:14.525051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4b7e6-da21-4286-ba29-028179e334b0 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:14.529638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:14.530241 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.530525 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.530797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.531522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:29:14.531827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:14.533420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:14.544918 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1274/2511] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 08:29:14.548823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f4570-fc06-4113-9fc7-1ff64f8d800b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:14.558535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f4570-fc06-4113-9fc7-1ff64f8d800b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:14.563175 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f96b2-6fa9-4a0c-9a4a-ca24ce158aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:14.563779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f96b2-6fa9-4a0c-9a4a-ca24ce158aff admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.564063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f96b2-6fa9-4a0c-9a4a-ca24ce158aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.564336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f96b2-6fa9-4a0c-9a4a-ca24ce158aff admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.564997 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f96b2-6fa9-4a0c-9a4a-ca24ce158aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:14.566963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f96b2-6fa9-4a0c-9a4a-ca24ce158aff admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:14.595018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1238/2512] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:14 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:14.599103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:14.609508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e161d0-64ba-4db9-9e1c-ef2b6cba9c02 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:14.663748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64314e88-d9a4-43c9-ae80-185d13eb3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:14.664352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314e88-d9a4-43c9-ae80-185d13eb3fac admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.664632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314e88-d9a4-43c9-ae80-185d13eb3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.664904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64314e88-d9a4-43c9-ae80-185d13eb3fac admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.665566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64314e88-d9a4-43c9-ae80-185d13eb3fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:14.668057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64314e88-d9a4-43c9-ae80-185d13eb3fac admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:14.678481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:14.691480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1275/2513] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:14 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:29:14.695533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f96b2-6fa9-4a0c-9a4a-ca24ce158aff admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:14.705822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f96b2-6fa9-4a0c-9a4a-ca24ce158aff admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:14.710414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccad27-2813-4b2b-930a-f3b8270988f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:14.711058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad27-2813-4b2b-930a-f3b8270988f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.711346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad27-2813-4b2b-930a-f3b8270988f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.711624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccad27-2813-4b2b-930a-f3b8270988f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.712317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccad27-2813-4b2b-930a-f3b8270988f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:14.713924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccad27-2813-4b2b-930a-f3b8270988f8 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:14.723647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1239/2514] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:14.727332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64314e88-d9a4-43c9-ae80-185d13eb3fac admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:14.737997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64314e88-d9a4-43c9-ae80-185d13eb3fac admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:14.742735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e8e06-97d5-4148-a9be-d10ee051643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:14.743371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8e06-97d5-4148-a9be-d10ee051643e admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.743655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8e06-97d5-4148-a9be-d10ee051643e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.743953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8e06-97d5-4148-a9be-d10ee051643e admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.744914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e8e06-97d5-4148-a9be-d10ee051643e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:14.747119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e8e06-97d5-4148-a9be-d10ee051643e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:14.758705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1276/2515] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:14.762490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccad27-2813-4b2b-930a-f3b8270988f8 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:14.772404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccad27-2813-4b2b-930a-f3b8270988f8 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:14.776999 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f5b25-ec19-4146-8a6c-5b4b5ddb0f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:14.777649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f5b25-ec19-4146-8a6c-5b4b5ddb0f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.777935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f5b25-ec19-4146-8a6c-5b4b5ddb0f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.778213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f5b25-ec19-4146-8a6c-5b4b5ddb0f93 admin admin] PATH_INFO: `/v3/projects/d16b601468ef44f98e1c73d969d533c9/users/113ef1acf8f84535939466f6eb3087ae/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.792848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f5b25-ec19-4146-8a6c-5b4b5ddb0f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16b601468ef44f98e1c73d969d533c9, user_id=113ef1acf8f84535939466f6eb3087ae, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:14.795599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f5b25-ec19-4146-8a6c-5b4b5ddb0f93 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:14.808951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1240/2516] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:14 2022] PUT /identity/v3/projects/d16b601468ef44f98e1c73d969d533c9/users/113ef1acf8f84535939466f6eb3087ae/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:29:14.819096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd8c4-2e89-4b9f-b465-414ed76046c7 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.819416 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd8c4-2e89-4b9f-b465-414ed76046c7 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.819702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd8c4-2e89-4b9f-b465-414ed76046c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.847387 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-cd8cd8c4-2e89-4b9f-b465-414ed76046c7 None None] MFA Rules not processed for user `113ef1acf8f84535939466f6eb3087ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:14.848786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cd8cd8c4-2e89-4b9f-b465-414ed76046c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:14.912137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1277/2517] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:14.916617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f5b25-ec19-4146-8a6c-5b4b5ddb0f93 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:14.978569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f5b25-ec19-4146-8a6c-5b4b5ddb0f93 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:14.983887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dea4aa-3372-4b05-97bc-518daff7fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:14.984500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea4aa-3372-4b05-97bc-518daff7fa28 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:14.984785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea4aa-3372-4b05-97bc-518daff7fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:14.985061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea4aa-3372-4b05-97bc-518daff7fa28 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:14.985736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dea4aa-3372-4b05-97bc-518daff7fa28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:14.987677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dea4aa-3372-4b05-97bc-518daff7fa28 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:15.013421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1241/2518] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:14 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:29:15.017428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cd8c4-2e89-4b9f-b465-414ed76046c7 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:15.028696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cd8c4-2e89-4b9f-b465-414ed76046c7 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:15.083971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba90e7-5386-4447-8cdf-fa3d80deba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:15.084524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba90e7-5386-4447-8cdf-fa3d80deba76 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:15.084814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba90e7-5386-4447-8cdf-fa3d80deba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:15.085089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba90e7-5386-4447-8cdf-fa3d80deba76 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:15.085747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba90e7-5386-4447-8cdf-fa3d80deba76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:15.087691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba90e7-5386-4447-8cdf-fa3d80deba76 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:15.110070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1278/2519] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:15 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:15.114126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dea4aa-3372-4b05-97bc-518daff7fa28 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:15.124478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dea4aa-3372-4b05-97bc-518daff7fa28 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:15.129249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180b411-2078-4c17-978b-98e9c939f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:15.129862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b411-2078-4c17-978b-98e9c939f7fa admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:15.130239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b411-2078-4c17-978b-98e9c939f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:15.130522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180b411-2078-4c17-978b-98e9c939f7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:15.131264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180b411-2078-4c17-978b-98e9c939f7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:15.132869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180b411-2078-4c17-978b-98e9c939f7fa admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:15.138136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:15.147230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1242/2520] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:15.148436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba90e7-5386-4447-8cdf-fa3d80deba76 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:15.159188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba90e7-5386-4447-8cdf-fa3d80deba76 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:15.163790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de935b-0cdc-4b67-8bf2-92147983a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:15.164446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de935b-0cdc-4b67-8bf2-92147983a7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:15.164726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de935b-0cdc-4b67-8bf2-92147983a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:15.164999 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de935b-0cdc-4b67-8bf2-92147983a7d0 admin admin] PATH_INFO: `/v3/projects/1521ed46c0d94f3f85123103c3934eff/users/a7ee9ef58c104ecab75e60405dcf5c0a/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:15.180051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de935b-0cdc-4b67-8bf2-92147983a7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1521ed46c0d94f3f85123103c3934eff, user_id=a7ee9ef58c104ecab75e60405dcf5c0a, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:15.182691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de935b-0cdc-4b67-8bf2-92147983a7d0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:15.195468 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1279/2521] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:15 2022] PUT /identity/v3/projects/1521ed46c0d94f3f85123103c3934eff/users/a7ee9ef58c104ecab75e60405dcf5c0a/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:15.199354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180b411-2078-4c17-978b-98e9c939f7fa admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:15.209338 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180b411-2078-4c17-978b-98e9c939f7fa admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:15.265751 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f42e54-7076-48e1-b2f6-d0864e0d666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:15.266369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42e54-7076-48e1-b2f6-d0864e0d666d admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:15.266657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42e54-7076-48e1-b2f6-d0864e0d666d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:15.266949 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42e54-7076-48e1-b2f6-d0864e0d666d admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:15.267655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f42e54-7076-48e1-b2f6-d0864e0d666d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:15.269250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f42e54-7076-48e1-b2f6-d0864e0d666d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:15.279637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1243/2522] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:15.283699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de935b-0cdc-4b67-8bf2-92147983a7d0 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:15.294775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de935b-0cdc-4b67-8bf2-92147983a7d0 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:15.299384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:15.300158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:15.300313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:15.300614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] PATH_INFO: `/v3/projects/1521ed46c0d94f3f85123103c3934eff/users/a7ee9ef58c104ecab75e60405dcf5c0a/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:15.302581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1521ed46c0d94f3f85123103c3934eff, user_id=a7ee9ef58c104ecab75e60405dcf5c0a, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:15.305255 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:15.315728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1280/2523] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:15 2022] PUT /identity/v3/projects/1521ed46c0d94f3f85123103c3934eff/users/a7ee9ef58c104ecab75e60405dcf5c0a/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:15.326235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac2c0-567d-4e8b-8826-677f5a8b07ea None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:15.326714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac2c0-567d-4e8b-8826-677f5a8b07ea None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:15.326836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac2c0-567d-4e8b-8826-677f5a8b07ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:15.354611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8f6ac2c0-567d-4e8b-8826-677f5a8b07ea None None] MFA Rules not processed for user `a7ee9ef58c104ecab75e60405dcf5c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:15.355798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8f6ac2c0-567d-4e8b-8826-677f5a8b07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:15.431287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1244/2524] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:15.442813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:15.444632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:15.480430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:15.509912 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe62a17-6e1a-4574-8784-6247bd08cf3b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:15.514148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c3180-458e-4937-a1d9-e67fe17810e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:15.514761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c3180-458e-4937-a1d9-e67fe17810e1 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:15.515099 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c3180-458e-4937-a1d9-e67fe17810e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:15.515376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c3180-458e-4937-a1d9-e67fe17810e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:15.524373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c3180-458e-4937-a1d9-e67fe17810e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:15.525799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c3180-458e-4937-a1d9-e67fe17810e1 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:15.535809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1281/2525] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:15 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:15.579240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ac2c0-567d-4e8b-8826-677f5a8b07ea None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:15.580617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8f6ac2c0-567d-4e8b-8826-677f5a8b07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:15.592930 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ac2c0-567d-4e8b-8826-677f5a8b07ea None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:15.596577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ec9c2-3074-447d-84a2-751d20bbb720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:15.597180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ec9c2-3074-447d-84a2-751d20bbb720 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:15.597457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ec9c2-3074-447d-84a2-751d20bbb720 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:15.597730 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ec9c2-3074-447d-84a2-751d20bbb720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:15.652884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ec9c2-3074-447d-84a2-751d20bbb720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:15.654308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ec9c2-3074-447d-84a2-751d20bbb720 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:15.663038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1245/2526] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:18.971518 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c3180-458e-4937-a1d9-e67fe17810e1 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:19.032703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c3180-458e-4937-a1d9-e67fe17810e1 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:19.037217 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:19.037843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:19.038126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:19.038401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] PATH_INFO: `/v3/users/113ef1acf8f84535939466f6eb3087ae` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:19.039556 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113ef1acf8f84535939466f6eb3087ae)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:19.041459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:19.085739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113ef1acf8f84535939466f6eb3087ae'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.093356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113ef1acf8f84535939466f6eb3087ae'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.100287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113ef1acf8f84535939466f6eb3087ae'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.100934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113ef1acf8f84535939466f6eb3087ae'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.112673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113ef1acf8f84535939466f6eb3087ae'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.118624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1282/2527] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:18 2022] DELETE /identity/v3/users/113ef1acf8f84535939466f6eb3087ae => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:19.123215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332477bd-1856-46c2-a023-d5d786e0f4ab None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:19.123740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332477bd-1856-46c2-a023-d5d786e0f4ab None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:19.123859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332477bd-1856-46c2-a023-d5d786e0f4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:19.143087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-332477bd-1856-46c2-a023-d5d786e0f4ab None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:19.144282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-332477bd-1856-46c2-a023-d5d786e0f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:19.157633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=100 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:19.203753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1246/2528] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:19.213441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:19.215511 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:19.268142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:19.272068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f0c0-77c2-4695-a290-38e167ae4b58 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:19.276935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472b168-0999-4902-8de3-e08b3acb7415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:19.278098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472b168-0999-4902-8de3-e08b3acb7415 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:19.278357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472b168-0999-4902-8de3-e08b3acb7415 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:19.278762 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472b168-0999-4902-8de3-e08b3acb7415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:19.288144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472b168-0999-4902-8de3-e08b3acb7415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:19.289573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472b168-0999-4902-8de3-e08b3acb7415 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:19.299013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1283/2529] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:19.561462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332477bd-1856-46c2-a023-d5d786e0f4ab None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:19.563044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-332477bd-1856-46c2-a023-d5d786e0f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:19.578659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332477bd-1856-46c2-a023-d5d786e0f4ab None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:19.584145 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:19.584833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:19.585244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:19.585418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] PATH_INFO: `/v3/projects/d16b601468ef44f98e1c73d969d533c9` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:19.586701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16b601468ef44f98e1c73d969d533c9)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:19.588567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:19.639917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16b601468ef44f98e1c73d969d533c9', 'request_id': 'req-12b31869-7656-4ff2-bda8-002409afdb96'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.646809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16b601468ef44f98e1c73d969d533c9', 'request_id': 'req-12b31869-7656-4ff2-bda8-002409afdb96'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.655827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16b601468ef44f98e1c73d969d533c9', 'request_id': 'req-12b31869-7656-4ff2-bda8-002409afdb96'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.666567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] The token cache is being invalidate because project d16b601468ef44f98e1c73d969d533c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:19.666892 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.667566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.670364 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1247/2530] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:19 2022] DELETE /identity/v3/projects/d16b601468ef44f98e1c73d969d533c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:19.673369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472b168-0999-4902-8de3-e08b3acb7415 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:19.684137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472b168-0999-4902-8de3-e08b3acb7415 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:19.742156 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:19.742793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:19.743109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:19.743381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] PATH_INFO: `/v3/users/a7ee9ef58c104ecab75e60405dcf5c0a` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:19.745300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ee9ef58c104ecab75e60405dcf5c0a)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:19.747275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:19.791281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ee9ef58c104ecab75e60405dcf5c0a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.798292 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ee9ef58c104ecab75e60405dcf5c0a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.805077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ee9ef58c104ecab75e60405dcf5c0a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.805699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ee9ef58c104ecab75e60405dcf5c0a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.817868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dff427df-6a5b-4b9d-a287-fe5d8726cd83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ee9ef58c104ecab75e60405dcf5c0a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:19.824185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1284/2531] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:19 2022] DELETE /identity/v3/users/a7ee9ef58c104ecab75e60405dcf5c0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:20.092568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:20.094030 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:20.107803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b31869-7656-4ff2-bda8-002409afdb96 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:20.167190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:20.167954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.168241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.168518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] PATH_INFO: `/v3/projects/1521ed46c0d94f3f85123103c3934eff` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.169681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1521ed46c0d94f3f85123103c3934eff)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:20.171629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:20.216597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:20.219778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1521ed46c0d94f3f85123103c3934eff', 'request_id': 'req-9628a75a-5057-46f9-997c-758807982718'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:20.226955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1521ed46c0d94f3f85123103c3934eff', 'request_id': 'req-9628a75a-5057-46f9-997c-758807982718'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:20.234419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1521ed46c0d94f3f85123103c3934eff', 'request_id': 'req-9628a75a-5057-46f9-997c-758807982718'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:20.245078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] The token cache is being invalidate because project 1521ed46c0d94f3f85123103c3934eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:20.245366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:20.245993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9628a75a-5057-46f9-997c-758807982718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:20.247538 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1248/2532] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:20 2022] DELETE /identity/v3/projects/1521ed46c0d94f3f85123103c3934eff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:20.252471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7051-4fc2-4b5f-aef9-834213c93c8f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.252950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7051-4fc2-4b5f-aef9-834213c93c8f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.253092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7051-4fc2-4b5f-aef9-834213c93c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.273659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-961b7051-4fc2-4b5f-aef9-834213c93c8f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:20.275063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-961b7051-4fc2-4b5f-aef9-834213c93c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:20.335287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1285/2533] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:20.344662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c8ca5-bf85-422e-b301-a4145a0e2e7f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.344957 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c8ca5-bf85-422e-b301-a4145a0e2e7f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.345236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c8ca5-bf85-422e-b301-a4145a0e2e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.364983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-f01c8ca5-bf85-422e-b301-a4145a0e2e7f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:20.366231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f01c8ca5-bf85-422e-b301-a4145a0e2e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:20.374627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1249/2534] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:20.378761 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b7051-4fc2-4b5f-aef9-834213c93c8f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:20.388490 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b7051-4fc2-4b5f-aef9-834213c93c8f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:20.393018 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:20.393622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.393902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.394174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.394863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:29:20.395195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:20.396784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:20.403854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:20.409637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1286/2535] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:29:20.413814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c8ca5-bf85-422e-b301-a4145a0e2e7f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:20.423684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c8ca5-bf85-422e-b301-a4145a0e2e7f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:20.428335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c9a0-2977-42ab-ac8d-ae21047204af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:20.428941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c9a0-2977-42ab-ac8d-ae21047204af admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.429223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c9a0-2977-42ab-ac8d-ae21047204af admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.429499 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c9a0-2977-42ab-ac8d-ae21047204af admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.430171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261c9a0-2977-42ab-ac8d-ae21047204af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:20.432124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261c9a0-2977-42ab-ac8d-ae21047204af admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:20.458370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1250/2536] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:20 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:29:20.462553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:20.472877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec326a1-8267-4afc-89ed-17ede605f774 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:20.527730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83202112-49d5-4c1b-bbda-16655192158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:20.528339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202112-49d5-4c1b-bbda-16655192158f admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.528618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202112-49d5-4c1b-bbda-16655192158f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.528890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202112-49d5-4c1b-bbda-16655192158f admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.529544 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83202112-49d5-4c1b-bbda-16655192158f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:20.531476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83202112-49d5-4c1b-bbda-16655192158f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:20.552920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1287/2537] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:20 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:20.557146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c9a0-2977-42ab-ac8d-ae21047204af admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:20.567372 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c9a0-2977-42ab-ac8d-ae21047204af admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:20.571995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2387-a936-4ca3-a3f0-f2a740fb486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:20.572599 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2387-a936-4ca3-a3f0-f2a740fb486d admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.572886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2387-a936-4ca3-a3f0-f2a740fb486d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.573669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd2387-a936-4ca3-a3f0-f2a740fb486d admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.574391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd2387-a936-4ca3-a3f0-f2a740fb486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:20.576018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd2387-a936-4ca3-a3f0-f2a740fb486d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:20.585791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1251/2538] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:20.590183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83202112-49d5-4c1b-bbda-16655192158f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:20.599882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83202112-49d5-4c1b-bbda-16655192158f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:20.604459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a1854-aee8-4d8e-b74e-bca7576e6e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:20.605054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1854-aee8-4d8e-b74e-bca7576e6e94 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.605335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1854-aee8-4d8e-b74e-bca7576e6e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.605608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1854-aee8-4d8e-b74e-bca7576e6e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.606295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a1854-aee8-4d8e-b74e-bca7576e6e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:20.607917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a1854-aee8-4d8e-b74e-bca7576e6e94 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:20.618277 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1288/2539] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:29:20.622334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2387-a936-4ca3-a3f0-f2a740fb486d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:20.632238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd2387-a936-4ca3-a3f0-f2a740fb486d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:20.637428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:20.638087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.638373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.638655 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] PATH_INFO: `/v3/projects/c9ee35ba58924507bfe753cd9498b61f/users/325842a0ed104b21b5abfe10300868d5/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.653413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ee35ba58924507bfe753cd9498b61f, user_id=325842a0ed104b21b5abfe10300868d5, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:20.656105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:20.669602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1252/2540] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:20 2022] PUT /identity/v3/projects/c9ee35ba58924507bfe753cd9498b61f/users/325842a0ed104b21b5abfe10300868d5/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:20.674882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5428-60d4-415a-90f5-565b47ad8fcf None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.675208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5428-60d4-415a-90f5-565b47ad8fcf None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.675596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5428-60d4-415a-90f5-565b47ad8fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.699617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-729b5428-60d4-415a-90f5-565b47ad8fcf None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:20.700815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-729b5428-60d4-415a-90f5-565b47ad8fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:20.764636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1289/2541] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:20.771037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:20.776965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:20.831580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3e47-6d7c-4347-8e69-d2cb44a3bc2b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:20.835225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbac0c-ac2d-4bdc-8279-cb18a3a80a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:20.835834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbac0c-ac2d-4bdc-8279-cb18a3a80a49 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:20.836114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbac0c-ac2d-4bdc-8279-cb18a3a80a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:20.836389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbac0c-ac2d-4bdc-8279-cb18a3a80a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:20.846474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbac0c-ac2d-4bdc-8279-cb18a3a80a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:20.847985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbac0c-ac2d-4bdc-8279-cb18a3a80a49 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:20.857894 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1253/2542] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:21.462261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2855-c8ac-4029-b73d-a492e648e74b None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:21.462823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2855-c8ac-4029-b73d-a492e648e74b None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:21.462823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb2855-c8ac-4029-b73d-a492e648e74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:21.491135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5ceb2855-c8ac-4029-b73d-a492e648e74b None None] MFA Rules not processed for user `325842a0ed104b21b5abfe10300868d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:21.492370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5ceb2855-c8ac-4029-b73d-a492e648e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:21.562349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1290/2543] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:29:21.566782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbac0c-ac2d-4bdc-8279-cb18a3a80a49 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:21.576861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbac0c-ac2d-4bdc-8279-cb18a3a80a49 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:21.581519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037c8d-8ac0-45e0-b77d-e6189390690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:21.582155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037c8d-8ac0-45e0-b77d-e6189390690f admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:21.582440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037c8d-8ac0-45e0-b77d-e6189390690f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:21.582718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62037c8d-8ac0-45e0-b77d-e6189390690f admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:21.583455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62037c8d-8ac0-45e0-b77d-e6189390690f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:21.585399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62037c8d-8ac0-45e0-b77d-e6189390690f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:21.617792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1254/2544] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:21 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:21.619227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb2855-c8ac-4029-b73d-a492e648e74b None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:21.631373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb2855-c8ac-4029-b73d-a492e648e74b None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:21.635129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:21.689497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53b254-09c0-4acf-9fc5-8bafb85a91fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:21.689669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b254-09c0-4acf-9fc5-8bafb85a91fc admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:21.689848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b254-09c0-4acf-9fc5-8bafb85a91fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:21.690118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b254-09c0-4acf-9fc5-8bafb85a91fc admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:21.690791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53b254-09c0-4acf-9fc5-8bafb85a91fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:21.692757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53b254-09c0-4acf-9fc5-8bafb85a91fc admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:21.719673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1291/2545] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:21 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:21.723722 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037c8d-8ac0-45e0-b77d-e6189390690f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:21.735097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62037c8d-8ac0-45e0-b77d-e6189390690f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:21.739818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42b817-fd50-4ea1-9622-82a79e0c530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:21.740430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42b817-fd50-4ea1-9622-82a79e0c530c admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:21.740715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42b817-fd50-4ea1-9622-82a79e0c530c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:21.740993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42b817-fd50-4ea1-9622-82a79e0c530c admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:21.741710 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42b817-fd50-4ea1-9622-82a79e0c530c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:21.743343 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42b817-fd50-4ea1-9622-82a79e0c530c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:21.754631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1255/2546] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:21.758914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53b254-09c0-4acf-9fc5-8bafb85a91fc admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:21.768948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53b254-09c0-4acf-9fc5-8bafb85a91fc admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:21.773628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e093e6-b200-4ec1-931d-b289dbae5390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:21.774291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e093e6-b200-4ec1-931d-b289dbae5390 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:21.774572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e093e6-b200-4ec1-931d-b289dbae5390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:21.774850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e093e6-b200-4ec1-931d-b289dbae5390 admin admin] PATH_INFO: `/v3/projects/8e51d485f6844f61ad2c4ffe74c70785/users/eb85ad6ba7f7461b97c11e157492ece7/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:21.792899 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e093e6-b200-4ec1-931d-b289dbae5390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e51d485f6844f61ad2c4ffe74c70785, user_id=eb85ad6ba7f7461b97c11e157492ece7, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:21.795621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e093e6-b200-4ec1-931d-b289dbae5390 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:21.809211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1292/2547] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:21 2022] PUT /identity/v3/projects/8e51d485f6844f61ad2c4ffe74c70785/users/eb85ad6ba7f7461b97c11e157492ece7/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:21.813278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42b817-fd50-4ea1-9622-82a79e0c530c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:21.823196 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42b817-fd50-4ea1-9622-82a79e0c530c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:21.863565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:21.883318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce8721-b5d6-42f0-b349-0a97c884db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:21.883872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8721-b5d6-42f0-b349-0a97c884db14 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:21.884152 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8721-b5d6-42f0-b349-0a97c884db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:21.884423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8721-b5d6-42f0-b349-0a97c884db14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:21.885107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce8721-b5d6-42f0-b349-0a97c884db14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:21.886695 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce8721-b5d6-42f0-b349-0a97c884db14 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:21.896226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1256/2548] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:21.900485 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e093e6-b200-4ec1-931d-b289dbae5390 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:21.911454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e093e6-b200-4ec1-931d-b289dbae5390 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:21.916021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:21.917321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:21.917607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:21.917878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] PATH_INFO: `/v3/projects/8e51d485f6844f61ad2c4ffe74c70785/users/eb85ad6ba7f7461b97c11e157492ece7/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:21.919883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e51d485f6844f61ad2c4ffe74c70785, user_id=eb85ad6ba7f7461b97c11e157492ece7, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:21.922495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:21.932425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1293/2549] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:21 2022] PUT /identity/v3/projects/8e51d485f6844f61ad2c4ffe74c70785/users/eb85ad6ba7f7461b97c11e157492ece7/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:22.546600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761919-5e6d-45b6-992c-9625da8d3f95 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:22.546891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761919-5e6d-45b6-992c-9625da8d3f95 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:22.547201 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761919-5e6d-45b6-992c-9625da8d3f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:22.575021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-35761919-5e6d-45b6-992c-9625da8d3f95 None None] MFA Rules not processed for user `eb85ad6ba7f7461b97c11e157492ece7`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:22.576279 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-35761919-5e6d-45b6-992c-9625da8d3f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:22.656213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1257/2550] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:22.668190 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:22.669916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:22.738082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb59196-5b48-4bfc-b4c5-229a5d853b72 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:22.742183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95681d-118d-486b-983d-1b605c8c30cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:22.743118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95681d-118d-486b-983d-1b605c8c30cf service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:22.743403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95681d-118d-486b-983d-1b605c8c30cf service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:22.743676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95681d-118d-486b-983d-1b605c8c30cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:22.811282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95681d-118d-486b-983d-1b605c8c30cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:22.813242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95681d-118d-486b-983d-1b605c8c30cf service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:22.823809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1294/2551] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:24.180177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761919-5e6d-45b6-992c-9625da8d3f95 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:24.181585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-35761919-5e6d-45b6-992c-9625da8d3f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:24.193368 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761919-5e6d-45b6-992c-9625da8d3f95 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:24.197003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:24.197615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:24.197927 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:24.198212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:24.207386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:24.208945 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:24.219500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1258/2552] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:32.818659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:34.215122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=51 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:35.598155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95681d-118d-486b-983d-1b605c8c30cf service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:35.607287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95681d-118d-486b-983d-1b605c8c30cf service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:35.610880 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:35.611459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:35.611740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:35.612012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:35.613875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:35.683983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:35.685432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:35.694314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1295/2553] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:40.766063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:40.767626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:40.871522 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9171bd-5083-4cb6-b91c-7c56729b526a service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:40.876826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:40.877663 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:40.877989 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:40.878448 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:40.880534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:40.893888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:40.895530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:40.906732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1259/2554] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:41.365435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:41.428345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114661b3-d0c7-4a38-a805-a241090dfc73 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:41.432840 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:41.434005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:41.434283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:41.434566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] PATH_INFO: `/v3/users/325842a0ed104b21b5abfe10300868d5` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:41.435757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325842a0ed104b21b5abfe10300868d5)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:41.437682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:41.481885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325842a0ed104b21b5abfe10300868d5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.489199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325842a0ed104b21b5abfe10300868d5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.498460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325842a0ed104b21b5abfe10300868d5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.499133 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325842a0ed104b21b5abfe10300868d5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.513149 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325842a0ed104b21b5abfe10300868d5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.519039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1296/2555] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:41 2022] DELETE /identity/v3/users/325842a0ed104b21b5abfe10300868d5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:41.695668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:41.708465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15e7d5-bc10-45c3-8223-c3bb2bfd80ff service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:41.765795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:41.766435 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:41.767017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:41.767158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] PATH_INFO: `/v3/projects/c9ee35ba58924507bfe753cd9498b61f` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:41.768257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ee35ba58924507bfe753cd9498b61f)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:41.770143 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:41.817881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ee35ba58924507bfe753cd9498b61f', 'request_id': 'req-3db598fb-3377-4c18-b6e0-859e24c7d943'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.824007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ee35ba58924507bfe753cd9498b61f', 'request_id': 'req-3db598fb-3377-4c18-b6e0-859e24c7d943'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.831231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ee35ba58924507bfe753cd9498b61f', 'request_id': 'req-3db598fb-3377-4c18-b6e0-859e24c7d943'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.841665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] The token cache is being invalidate because project c9ee35ba58924507bfe753cd9498b61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:41.842039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.842793 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.844555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1260/2556] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:41 2022] DELETE /identity/v3/projects/c9ee35ba58924507bfe753cd9498b61f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:41.848674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:41.850063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:41.863732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf916e-47ad-4dcf-ad11-a3a668afe8e4 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:41.867414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:41.924859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:41.925505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:41.925792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:41.926074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] PATH_INFO: `/v3/users/eb85ad6ba7f7461b97c11e157492ece7` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:41.927294 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb85ad6ba7f7461b97c11e157492ece7)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:41.929220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:41.974689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb85ad6ba7f7461b97c11e157492ece7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.982696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb85ad6ba7f7461b97c11e157492ece7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.989620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb85ad6ba7f7461b97c11e157492ece7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:41.990244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb85ad6ba7f7461b97c11e157492ece7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:42.002418 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2bcceab9-f79f-4daa-b9b8-10d50c176309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb85ad6ba7f7461b97c11e157492ece7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:42.008333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1297/2557] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:41 2022] DELETE /identity/v3/users/eb85ad6ba7f7461b97c11e157492ece7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:42.177160 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:42.178737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:42.195675 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db598fb-3377-4c18-b6e0-859e24c7d943 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:42.213287 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:42.254991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:42.255637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.255922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.256199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] PATH_INFO: `/v3/projects/8e51d485f6844f61ad2c4ffe74c70785` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.257389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e51d485f6844f61ad2c4ffe74c70785)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:42.259338 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:42.306822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e51d485f6844f61ad2c4ffe74c70785', 'request_id': 'req-db1df49c-61a9-408e-a508-ccf0481f1e2a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:42.313587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e51d485f6844f61ad2c4ffe74c70785', 'request_id': 'req-db1df49c-61a9-408e-a508-ccf0481f1e2a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:42.321375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e51d485f6844f61ad2c4ffe74c70785', 'request_id': 'req-db1df49c-61a9-408e-a508-ccf0481f1e2a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:42.333638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] The token cache is being invalidate because project 8e51d485f6844f61ad2c4ffe74c70785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:42.333928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:42.334565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-db1df49c-61a9-408e-a508-ccf0481f1e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:42.336302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1261/2558] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:42 2022] DELETE /identity/v3/projects/8e51d485f6844f61ad2c4ffe74c70785 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:42.341590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb97d3-add7-44fe-a951-ce65a6f7a323 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.341952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb97d3-add7-44fe-a951-ce65a6f7a323 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.342297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb97d3-add7-44fe-a951-ce65a6f7a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.362818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-80eb97d3-add7-44fe-a951-ce65a6f7a323 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:42.363984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-80eb97d3-add7-44fe-a951-ce65a6f7a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:42.425874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1298/2559] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:42.433705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c2203-df82-4f56-86b6-4fafc0d95504 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.434029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c2203-df82-4f56-86b6-4fafc0d95504 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.434487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c2203-df82-4f56-86b6-4fafc0d95504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.455420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-677c2203-df82-4f56-86b6-4fafc0d95504 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:42.456759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-677c2203-df82-4f56-86b6-4fafc0d95504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:42.465572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1262/2560] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:29:42.470114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb97d3-add7-44fe-a951-ce65a6f7a323 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:42.480707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb97d3-add7-44fe-a951-ce65a6f7a323 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:42.485447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:42.486049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.486340 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.486705 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.487347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:29:42.487711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:42.489269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:42.501724 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1299/2561] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 08:29:42.506880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c2203-df82-4f56-86b6-4fafc0d95504 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:42.516954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c2203-df82-4f56-86b6-4fafc0d95504 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:42.537873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441defce-e1a6-467a-beca-c703d9ac961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:42.538620 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441defce-e1a6-467a-beca-c703d9ac961e admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.538998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441defce-e1a6-467a-beca-c703d9ac961e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.539341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441defce-e1a6-467a-beca-c703d9ac961e admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.540096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441defce-e1a6-467a-beca-c703d9ac961e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:42.542135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441defce-e1a6-467a-beca-c703d9ac961e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:42.575351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1263/2562] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:42 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:29:42.576855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:42.591295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd033-abc3-4650-a8f5-5f93ae3c7d93 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:42.601952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:42.653778 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6487df3-f4da-491d-9e18-c7ef281fab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:42.654402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6487df3-f4da-491d-9e18-c7ef281fab56 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.654682 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6487df3-f4da-491d-9e18-c7ef281fab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.654979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6487df3-f4da-491d-9e18-c7ef281fab56 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.655651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6487df3-f4da-491d-9e18-c7ef281fab56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:42.657577 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6487df3-f4da-491d-9e18-c7ef281fab56 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:42.677965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1300/2563] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:42 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:29:42.682215 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441defce-e1a6-467a-beca-c703d9ac961e admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:42.693316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441defce-e1a6-467a-beca-c703d9ac961e admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:42.698052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197940c-23d1-4d0a-9f07-ffba5ec935ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:42.699309 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197940c-23d1-4d0a-9f07-ffba5ec935ef admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.699605 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197940c-23d1-4d0a-9f07-ffba5ec935ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.699885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197940c-23d1-4d0a-9f07-ffba5ec935ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.700586 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197940c-23d1-4d0a-9f07-ffba5ec935ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:42.702244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197940c-23d1-4d0a-9f07-ffba5ec935ef admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:42.712439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1264/2564] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:42.716350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6487df3-f4da-491d-9e18-c7ef281fab56 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:42.726440 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6487df3-f4da-491d-9e18-c7ef281fab56 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:42.731261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e5aa-8479-46eb-a7c9-4dd5284c9b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:42.731878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e5aa-8479-46eb-a7c9-4dd5284c9b3d admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.732163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e5aa-8479-46eb-a7c9-4dd5284c9b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.732442 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e5aa-8479-46eb-a7c9-4dd5284c9b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.733143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e5aa-8479-46eb-a7c9-4dd5284c9b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:42.734733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e5aa-8479-46eb-a7c9-4dd5284c9b3d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:42.746111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1301/2565] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:42.749933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197940c-23d1-4d0a-9f07-ffba5ec935ef admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:42.759644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197940c-23d1-4d0a-9f07-ffba5ec935ef admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:42.764903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:42.765554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.765845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.766124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] PATH_INFO: `/v3/projects/9ee6253eb3b6464bacf61272c091b2a4/users/3a0ce88118574351bbf0fe80b72eb981/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.780284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee6253eb3b6464bacf61272c091b2a4, user_id=3a0ce88118574351bbf0fe80b72eb981, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:42.782918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:42.795878 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1265/2566] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:42 2022] PUT /identity/v3/projects/9ee6253eb3b6464bacf61272c091b2a4/users/3a0ce88118574351bbf0fe80b72eb981/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:29:42.806070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf36d-3a85-4c8e-8fb4-53d6870c3dbe None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.806363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf36d-3a85-4c8e-8fb4-53d6870c3dbe None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.806870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf36d-3a85-4c8e-8fb4-53d6870c3dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.837185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-010bf36d-3a85-4c8e-8fb4-53d6870c3dbe None None] MFA Rules not processed for user `3a0ce88118574351bbf0fe80b72eb981`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:42.838405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-010bf36d-3a85-4c8e-8fb4-53d6870c3dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:42.904252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1302/2567] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:42.915178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:42.916942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:42.968583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:42.974712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279285d5-0d61-49a0-8038-da085e390976 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:42.979316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0d3d1-c757-47b0-a2fd-926c20fa24e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:42.979944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0d3d1-c757-47b0-a2fd-926c20fa24e0 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:42.980227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0d3d1-c757-47b0-a2fd-926c20fa24e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:42.980513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0d3d1-c757-47b0-a2fd-926c20fa24e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:42.988943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0d3d1-c757-47b0-a2fd-926c20fa24e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:42.990374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0d3d1-c757-47b0-a2fd-926c20fa24e0 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:42.999901 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1266/2568] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:50.184335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bf36d-3a85-4c8e-8fb4-53d6870c3dbe None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:50.266128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bf36d-3a85-4c8e-8fb4-53d6870c3dbe None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:50.281541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:50.281541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:50.281541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:50.281541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] PATH_INFO: `/v3/users/3a0ce88118574351bbf0fe80b72eb981` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:50.282314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0ce88118574351bbf0fe80b72eb981)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:50.282314 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:50.302062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:50.330745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0ce88118574351bbf0fe80b72eb981'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.338649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0ce88118574351bbf0fe80b72eb981'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.345869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0ce88118574351bbf0fe80b72eb981'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.346529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0ce88118574351bbf0fe80b72eb981'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.359172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0ce88118574351bbf0fe80b72eb981'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.364983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1303/2569] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:29:50 2022] DELETE /identity/v3/users/3a0ce88118574351bbf0fe80b72eb981 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:50.369701 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1385f-4e9e-439a-9a40-76fe3a675fe2 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:50.370224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1385f-4e9e-439a-9a40-76fe3a675fe2 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:50.370224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1385f-4e9e-439a-9a40-76fe3a675fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:50.391058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-80d1385f-4e9e-439a-9a40-76fe3a675fe2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:50.392290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-80d1385f-4e9e-439a-9a40-76fe3a675fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:50.452428 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1267/2570] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:50.462096 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:50.463533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:50.532142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678b608-201b-4fb6-9885-a5b1bc10d0b6 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:50.535792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5e2e9-8425-4efe-aae8-7c64ff101eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:50.536402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5e2e9-8425-4efe-aae8-7c64ff101eeb service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:50.536688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5e2e9-8425-4efe-aae8-7c64ff101eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:50.536963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5e2e9-8425-4efe-aae8-7c64ff101eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:50.546398 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5e2e9-8425-4efe-aae8-7c64ff101eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:50.547857 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5e2e9-8425-4efe-aae8-7c64ff101eeb service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:50.557153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1304/2571] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:29:50.817951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1385f-4e9e-439a-9a40-76fe3a675fe2 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:50.819455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-80d1385f-4e9e-439a-9a40-76fe3a675fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:50.831562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1385f-4e9e-439a-9a40-76fe3a675fe2 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:50.836379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:50.837050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:50.837325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:50.837593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] PATH_INFO: `/v3/projects/9ee6253eb3b6464bacf61272c091b2a4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:50.838911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee6253eb3b6464bacf61272c091b2a4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:50.841815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:50.900054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee6253eb3b6464bacf61272c091b2a4', 'request_id': 'req-da66038a-4617-460c-b9c7-a615811abfe8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.906654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee6253eb3b6464bacf61272c091b2a4', 'request_id': 'req-da66038a-4617-460c-b9c7-a615811abfe8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.913660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee6253eb3b6464bacf61272c091b2a4', 'request_id': 'req-da66038a-4617-460c-b9c7-a615811abfe8'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.923752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] The token cache is being invalidate because project 9ee6253eb3b6464bacf61272c091b2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:29:50.924036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.924674 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-da66038a-4617-460c-b9c7-a615811abfe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:29:50.926168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1268/2572] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:29:50 2022] DELETE /identity/v3/projects/9ee6253eb3b6464bacf61272c091b2a4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:50.931111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7c9c-9e72-4158-96aa-f57c20d11843 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:50.931412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7c9c-9e72-4158-96aa-f57c20d11843 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:50.931698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7c9c-9e72-4158-96aa-f57c20d11843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:50.951382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-582e7c9c-9e72-4158-96aa-f57c20d11843 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:50.952591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-582e7c9c-9e72-4158-96aa-f57c20d11843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:51.010711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1305/2573] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:51.019059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d238-cecc-4179-975b-81f91aa23022 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.019353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d238-cecc-4179-975b-81f91aa23022 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.019632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d238-cecc-4179-975b-81f91aa23022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.039227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9e52d238-cecc-4179-975b-81f91aa23022 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:51.040434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9e52d238-cecc-4179-975b-81f91aa23022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:51.048245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1269/2574] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:51.052379 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7c9c-9e72-4158-96aa-f57c20d11843 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:51.062095 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7c9c-9e72-4158-96aa-f57c20d11843 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:51.066646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:51.067286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.067573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.067871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.068570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:29:51.068881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:51.070479 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:51.082419 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1306/2575] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:29:51.086356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52d238-cecc-4179-975b-81f91aa23022 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:51.095914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52d238-cecc-4179-975b-81f91aa23022 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:51.100544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8538-40f6-44a0-bc36-07ee4f856b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:51.101139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8538-40f6-44a0-bc36-07ee4f856b17 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.101424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8538-40f6-44a0-bc36-07ee4f856b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.101694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8538-40f6-44a0-bc36-07ee4f856b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.102359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d8538-40f6-44a0-bc36-07ee4f856b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:51.104296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d8538-40f6-44a0-bc36-07ee4f856b17 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:51.130303 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1270/2576] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:29:51 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:51.134346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:51.144840 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9a68-a8da-4f39-a89c-6d99ea7c3c07 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:51.162541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:51.202618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4ca48-698a-498f-94ab-b02fc320ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:51.203254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4ca48-698a-498f-94ab-b02fc320ae0b admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.203536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4ca48-698a-498f-94ab-b02fc320ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.203804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4ca48-698a-498f-94ab-b02fc320ae0b admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.204460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4ca48-698a-498f-94ab-b02fc320ae0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:51.206365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4ca48-698a-498f-94ab-b02fc320ae0b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:51.229640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1307/2577] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:29:51 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:29:51.230798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8538-40f6-44a0-bc36-07ee4f856b17 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:51.241171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8538-40f6-44a0-bc36-07ee4f856b17 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:51.245966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94dec4-69ca-4c8f-bcc7-5c647cb641c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:51.246568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94dec4-69ca-4c8f-bcc7-5c647cb641c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.246876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94dec4-69ca-4c8f-bcc7-5c647cb641c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.247178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94dec4-69ca-4c8f-bcc7-5c647cb641c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.247906 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94dec4-69ca-4c8f-bcc7-5c647cb641c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:51.249489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94dec4-69ca-4c8f-bcc7-5c647cb641c1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:51.259198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1271/2578] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:29:51.263675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4ca48-698a-498f-94ab-b02fc320ae0b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:51.273535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4ca48-698a-498f-94ab-b02fc320ae0b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:51.278991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957a7f9-c478-4bde-ad20-07773270554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:51.279609 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a7f9-c478-4bde-ad20-07773270554d admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.279889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a7f9-c478-4bde-ad20-07773270554d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.280162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a7f9-c478-4bde-ad20-07773270554d admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.280858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957a7f9-c478-4bde-ad20-07773270554d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:51.282441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957a7f9-c478-4bde-ad20-07773270554d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:51.293409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1308/2579] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:29:51.297626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94dec4-69ca-4c8f-bcc7-5c647cb641c1 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:51.307729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94dec4-69ca-4c8f-bcc7-5c647cb641c1 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:51.314241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:51.315150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.315465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.315752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] PATH_INFO: `/v3/projects/ac4e21b1e94043389a16f4800fb905af/users/d31285002f5f462bb9ad8fb9f7ea70fd/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.331777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4e21b1e94043389a16f4800fb905af, user_id=d31285002f5f462bb9ad8fb9f7ea70fd, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:51.334490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:51.356024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1272/2580] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:29:51 2022] PUT /identity/v3/projects/ac4e21b1e94043389a16f4800fb905af/users/d31285002f5f462bb9ad8fb9f7ea70fd/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:29:51.360982 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d0e7c-98d4-490e-89f7-e6d054b8c0d1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.361308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d0e7c-98d4-490e-89f7-e6d054b8c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.361584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d0e7c-98d4-490e-89f7-e6d054b8c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.417286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-2b5d0e7c-98d4-490e-89f7-e6d054b8c0d1 None None] MFA Rules not processed for user `d31285002f5f462bb9ad8fb9f7ea70fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:29:51.418546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2b5d0e7c-98d4-490e-89f7-e6d054b8c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:51.498599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1309/2581] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:29:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:29:51.512302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:29:51.523937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:29:51.541476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:29:51.609013 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd782324-e76f-47df-b722-9c969591c721 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:29:51.612752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde6248cf0794fab88a093097b597c9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:29:51.613397 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:29:51.613681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:29:51.613958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:29:51.623071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:29:51.624501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:29:51.633270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1273/2582] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:29:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:30:01.493405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:01.611503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d0e7c-98d4-490e-89f7-e6d054b8c0d1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:01.613121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2b5d0e7c-98d4-490e-89f7-e6d054b8c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:01.629749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=31 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:01.671377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d0e7c-98d4-490e-89f7-e6d054b8c0d1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:01.675364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:01.676407 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:01.676698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:01.676975 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:01.679011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:01.744849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:01.746304 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:01.756410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1310/2583] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:30:02.271477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:02.272974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:02.289573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc31c5-dd13-4b3f-b586-3d8480d0ffc6 service glance] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:02.294243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:02.294884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:02.295197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:02.295476 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] PATH_INFO: `/v3/users/2adcae0906b8475c9853df17155c757e` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:02.296644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adcae0906b8475c9853df17155c757e)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:02.298643 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:02.346204 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adcae0906b8475c9853df17155c757e'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.353960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adcae0906b8475c9853df17155c757e'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.354657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adcae0906b8475c9853df17155c757e'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.366526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adcae0906b8475c9853df17155c757e'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.367391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-220c85b1-aebd-4266-a67b-4f8bc4569119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adcae0906b8475c9853df17155c757e'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.380438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1274/2584] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:30:02 2022] DELETE /identity/v3/users/2adcae0906b8475c9853df17155c757e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:30:02.554264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:02.565389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2794-0f34-4fa9-858f-79e33bb4c3b3 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:02.642496 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:02.643201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:02.643504 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:02.643764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] PATH_INFO: `/v3/projects/b26ad84b9d4445e7be358f671dbfce96` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:02.645547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26ad84b9d4445e7be358f671dbfce96)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:02.647514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:02.821162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26ad84b9d4445e7be358f671dbfce96', 'request_id': 'req-825494d7-7cc2-4a65-b138-a7f0b534d4c5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.823704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:02.828516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26ad84b9d4445e7be358f671dbfce96', 'request_id': 'req-825494d7-7cc2-4a65-b138-a7f0b534d4c5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.835538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26ad84b9d4445e7be358f671dbfce96', 'request_id': 'req-825494d7-7cc2-4a65-b138-a7f0b534d4c5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.848221 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] The token cache is being invalidate because project b26ad84b9d4445e7be358f671dbfce96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:30:02.848635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.849436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-825494d7-7cc2-4a65-b138-a7f0b534d4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:02.851120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1311/2585] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:30:02 2022] DELETE /identity/v3/projects/b26ad84b9d4445e7be358f671dbfce96 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:30:02.856144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6161ed-dce2-4cce-9159-6051c841807a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:02.856647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6161ed-dce2-4cce-9159-6051c841807a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:02.856834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6161ed-dce2-4cce-9159-6051c841807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:02.878539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9f6161ed-dce2-4cce-9159-6051c841807a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:02.880430 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9f6161ed-dce2-4cce-9159-6051c841807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:02.940527 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1275/2586] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:30:02.948993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f6f0-95c6-4cb3-b78d-82fb5773d414 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:02.949286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f6f0-95c6-4cb3-b78d-82fb5773d414 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:02.949567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f6f0-95c6-4cb3-b78d-82fb5773d414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:02.968484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-fb08f6f0-95c6-4cb3-b78d-82fb5773d414 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:02.969691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fb08f6f0-95c6-4cb3-b78d-82fb5773d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:02.977850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1312/2587] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:30:02.981910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6161ed-dce2-4cce-9159-6051c841807a None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:02.992529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6161ed-dce2-4cce-9159-6051c841807a None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:02.997410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:02.998021 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:02.998306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:02.998585 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:02.999317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:30:02.999627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:03.001225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:03.013419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1276/2588] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:30:03.017625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f6f0-95c6-4cb3-b78d-82fb5773d414 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:03.026805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f6f0-95c6-4cb3-b78d-82fb5773d414 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:03.031432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d507f-f14e-4174-b0d7-1f4666582cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:03.032031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d507f-f14e-4174-b0d7-1f4666582cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:03.032310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d507f-f14e-4174-b0d7-1f4666582cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:03.032584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d507f-f14e-4174-b0d7-1f4666582cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:03.033244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d507f-f14e-4174-b0d7-1f4666582cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:03.035218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d507f-f14e-4174-b0d7-1f4666582cf3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:03.061599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1313/2589] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:30:03 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:30:03.065690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:03.076359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f98fc-c2a8-4156-9fe2-6ae064253ae3 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:03.138141 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39131-3558-4939-ae55-ad19dcec40fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:03.138873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39131-3558-4939-ae55-ad19dcec40fc admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:03.139079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39131-3558-4939-ae55-ad19dcec40fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:03.139360 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39131-3558-4939-ae55-ad19dcec40fc admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:03.140031 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a39131-3558-4939-ae55-ad19dcec40fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:03.141966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a39131-3558-4939-ae55-ad19dcec40fc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:03.150186 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:03.165101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1277/2590] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:30:03 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:30:03.169195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d507f-f14e-4174-b0d7-1f4666582cf3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:03.179932 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d507f-f14e-4174-b0d7-1f4666582cf3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:03.184497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93962f-f6a4-4b73-8b08-d55c7826056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:03.185103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93962f-f6a4-4b73-8b08-d55c7826056a admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:03.185385 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93962f-f6a4-4b73-8b08-d55c7826056a admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:03.185660 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93962f-f6a4-4b73-8b08-d55c7826056a admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:03.186353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93962f-f6a4-4b73-8b08-d55c7826056a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:03.187978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93962f-f6a4-4b73-8b08-d55c7826056a admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:03.197652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1314/2591] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:30:03.201341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39131-3558-4939-ae55-ad19dcec40fc admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:03.211478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39131-3558-4939-ae55-ad19dcec40fc admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:03.216085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e91575-ff0d-4415-ae70-b03f6f775e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:03.216693 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91575-ff0d-4415-ae70-b03f6f775e13 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:03.216973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91575-ff0d-4415-ae70-b03f6f775e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:03.217247 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e91575-ff0d-4415-ae70-b03f6f775e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:03.217939 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e91575-ff0d-4415-ae70-b03f6f775e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:03.219564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e91575-ff0d-4415-ae70-b03f6f775e13 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:03.230719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1278/2592] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:30:03.234814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93962f-f6a4-4b73-8b08-d55c7826056a admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:03.245549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93962f-f6a4-4b73-8b08-d55c7826056a admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:03.250197 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:03.250851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:03.251168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:03.251444 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] PATH_INFO: `/v3/projects/a7631e3db11f429d80138098922305f0/users/5bec38b5d16647bab07d4ad06ab0f094/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:03.265441 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7631e3db11f429d80138098922305f0, user_id=5bec38b5d16647bab07d4ad06ab0f094, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:03.268075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:03.280350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1315/2593] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:30:03 2022] PUT /identity/v3/projects/a7631e3db11f429d80138098922305f0/users/5bec38b5d16647bab07d4ad06ab0f094/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:30:03.285772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d06f6-b71b-4e89-b757-e1e743d705de None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:03.286060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d06f6-b71b-4e89-b757-e1e743d705de None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:03.286333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d06f6-b71b-4e89-b757-e1e743d705de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:03.306459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-3e6d06f6-b71b-4e89-b757-e1e743d705de None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:03.307821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3e6d06f6-b71b-4e89-b757-e1e743d705de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:03.365734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1279/2594] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:30:03.375475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:03.377163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:03.435073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfabd3f-f52a-4f4a-a971-c88477df00e3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:03.438644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec10631-761e-4362-bec6-de2cbde65116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:03.439286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec10631-761e-4362-bec6-de2cbde65116 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:03.439570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec10631-761e-4362-bec6-de2cbde65116 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:03.439846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec10631-761e-4362-bec6-de2cbde65116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:03.448612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec10631-761e-4362-bec6-de2cbde65116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:03.450062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec10631-761e-4362-bec6-de2cbde65116 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:03.459786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1316/2595] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:30:07.403071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c2e3-1fac-41b4-b9ad-852b53c2ae91 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:07.403924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c2e3-1fac-41b4-b9ad-852b53c2ae91 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:07.404200 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c2e3-1fac-41b4-b9ad-852b53c2ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:07.432805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7ec0c2e3-1fac-41b4-b9ad-852b53c2ae91 None None] MFA Rules not processed for user `5bec38b5d16647bab07d4ad06ab0f094`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:07.434051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7ec0c2e3-1fac-41b4-b9ad-852b53c2ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:07.501094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1280/2596] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:30:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:30:07.508510 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec10631-761e-4362-bec6-de2cbde65116 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:07.518497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec10631-761e-4362-bec6-de2cbde65116 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:07.524709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc56907-01c7-41b8-991b-3e59c6daba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:07.525413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc56907-01c7-41b8-991b-3e59c6daba6b admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:07.525697 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc56907-01c7-41b8-991b-3e59c6daba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:07.525969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc56907-01c7-41b8-991b-3e59c6daba6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:07.526634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc56907-01c7-41b8-991b-3e59c6daba6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:07.528554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc56907-01c7-41b8-991b-3e59c6daba6b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:07.560084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1317/2597] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:30:07 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:30:07.565168 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0c2e3-1fac-41b4-b9ad-852b53c2ae91 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:07.576964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0c2e3-1fac-41b4-b9ad-852b53c2ae91 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:07.636265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9bffe-5abd-4638-8322-973a571c9f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:07.636899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9bffe-5abd-4638-8322-973a571c9f0a admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:07.637185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9bffe-5abd-4638-8322-973a571c9f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:07.637466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9bffe-5abd-4638-8322-973a571c9f0a admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:07.638154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9bffe-5abd-4638-8322-973a571c9f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:07.640211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9bffe-5abd-4638-8322-973a571c9f0a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:07.657231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:07.667135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1281/2598] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:30:07 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:30:07.668236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc56907-01c7-41b8-991b-3e59c6daba6b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:07.680404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc56907-01c7-41b8-991b-3e59c6daba6b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:07.693342 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66190221-36b2-4bd7-8849-0f9e3ed8ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:07.694450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190221-36b2-4bd7-8849-0f9e3ed8ca20 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:07.694734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190221-36b2-4bd7-8849-0f9e3ed8ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:07.695035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190221-36b2-4bd7-8849-0f9e3ed8ca20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:07.695753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66190221-36b2-4bd7-8849-0f9e3ed8ca20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:07.697524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66190221-36b2-4bd7-8849-0f9e3ed8ca20 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:07.718617 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1318/2599] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:30:07.722978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9bffe-5abd-4638-8322-973a571c9f0a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:07.733058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9bffe-5abd-4638-8322-973a571c9f0a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:07.742477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc34ab-dcac-4de2-9ebc-d11fb21b3d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:07.744621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc34ab-dcac-4de2-9ebc-d11fb21b3d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:07.744914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc34ab-dcac-4de2-9ebc-d11fb21b3d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:07.745189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc34ab-dcac-4de2-9ebc-d11fb21b3d95 admin admin] PATH_INFO: `/v3/projects/f01d12092c1649daa99d4d2f72e135c6/users/890294f9bbb0439498b2d44d67f84a04/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:07.762799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc34ab-dcac-4de2-9ebc-d11fb21b3d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01d12092c1649daa99d4d2f72e135c6, user_id=890294f9bbb0439498b2d44d67f84a04, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:07.765587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc34ab-dcac-4de2-9ebc-d11fb21b3d95 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:07.779899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1282/2600] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:30:07 2022] PUT /identity/v3/projects/f01d12092c1649daa99d4d2f72e135c6/users/890294f9bbb0439498b2d44d67f84a04/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:30:07.783745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66190221-36b2-4bd7-8849-0f9e3ed8ca20 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:07.795330 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66190221-36b2-4bd7-8849-0f9e3ed8ca20 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:07.845517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:07.863024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f926662-b141-46c6-911d-e0311f2cf886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:07.864180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926662-b141-46c6-911d-e0311f2cf886 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:07.864661 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926662-b141-46c6-911d-e0311f2cf886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:07.864942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f926662-b141-46c6-911d-e0311f2cf886 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:07.866394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f926662-b141-46c6-911d-e0311f2cf886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:07.868144 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f926662-b141-46c6-911d-e0311f2cf886 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:07.879451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1319/2601] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:30:07.884033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc34ab-dcac-4de2-9ebc-d11fb21b3d95 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:07.896634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc34ab-dcac-4de2-9ebc-d11fb21b3d95 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:07.901304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:07.901976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:07.902260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:07.902536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] PATH_INFO: `/v3/projects/f01d12092c1649daa99d4d2f72e135c6/users/890294f9bbb0439498b2d44d67f84a04/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:07.904577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01d12092c1649daa99d4d2f72e135c6, user_id=890294f9bbb0439498b2d44d67f84a04, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:07.907274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:07.918899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1283/2602] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:30:07 2022] PUT /identity/v3/projects/f01d12092c1649daa99d4d2f72e135c6/users/890294f9bbb0439498b2d44d67f84a04/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:30:12.401186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f9af-77c7-4601-80d3-16389f2db81e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:12.401735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f9af-77c7-4601-80d3-16389f2db81e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:12.401735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f9af-77c7-4601-80d3-16389f2db81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:12.429968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-0d51f9af-77c7-4601-80d3-16389f2db81e None None] MFA Rules not processed for user `890294f9bbb0439498b2d44d67f84a04`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:12.431132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0d51f9af-77c7-4601-80d3-16389f2db81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:12.502893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1320/2603] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:30:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:30:12.515187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:12.516874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:12.544929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f9af-77c7-4601-80d3-16389f2db81e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:12.546867 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0d51f9af-77c7-4601-80d3-16389f2db81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:12.580753 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64263c-dc6c-41cc-a578-b64cd0e75d7c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:12.585342 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb65d93-1cfc-4c5b-a356-b3123b920e40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde6248cf0794fab88a093097b597c9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:12.585979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb65d93-1cfc-4c5b-a356-b3123b920e40 service glance] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:12.586262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb65d93-1cfc-4c5b-a356-b3123b920e40 service glance] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:12.586544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb65d93-1cfc-4c5b-a356-b3123b920e40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:12.620788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f9af-77c7-4601-80d3-16389f2db81e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:12.625059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:12.625786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:12.626344 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:12.626706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:12.630263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:12.656592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb65d93-1cfc-4c5b-a356-b3123b920e40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:12.658290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb65d93-1cfc-4c5b-a356-b3123b920e40 service glance] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:12.670684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1284/2604] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:30:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:30:12.731850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:12.734228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:12.747882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1321/2605] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:30:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:30:12.809714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be8b8-d73d-4fcb-a410-ec3d64c3040a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:12.809992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be8b8-d73d-4fcb-a410-ec3d64c3040a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:12.810369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be8b8-d73d-4fcb-a410-ec3d64c3040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:12.872608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-752be8b8-d73d-4fcb-a410-ec3d64c3040a None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:12.873839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-752be8b8-d73d-4fcb-a410-ec3d64c3040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:12.922528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:12.945771 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1285/2606] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 08:30:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:30:13.006375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:13.009131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:13.023459 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:13.108627 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c78db-a6a6-4c54-ac19-018ba042952c service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:13.114417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747a681-c949-45c5-98fc-513104463a77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:13.115077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747a681-c949-45c5-98fc-513104463a77 service swift] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:13.115361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747a681-c949-45c5-98fc-513104463a77 service swift] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:13.115637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747a681-c949-45c5-98fc-513104463a77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:13.125680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747a681-c949-45c5-98fc-513104463a77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:13.127212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747a681-c949-45c5-98fc-513104463a77 service swift] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:13.136244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1322/2607] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 08:30:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 08:30:21.970905 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f2d0-27b3-41b3-8617-a1dfec1199e4 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:21.971443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f2d0-27b3-41b3-8617-a1dfec1199e4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:21.971567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6f2d0-27b3-41b3-8617-a1dfec1199e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:21.990627 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-d5e6f2d0-27b3-41b3-8617-a1dfec1199e4 None None] MFA Rules not processed for user `5bec38b5d16647bab07d4ad06ab0f094`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:21.991856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d5e6f2d0-27b3-41b3-8617-a1dfec1199e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:21.998881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1286/2608] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:30:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:30:22.249996 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747a681-c949-45c5-98fc-513104463a77 service swift] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:22.304024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747a681-c949-45c5-98fc-513104463a77 service swift] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:22.307612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:22.308216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:22.308495 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:22.308765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:22.310512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:22.320401 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:22.321757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:22.329613 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1323/2609] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:30:26.606823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc76d1a-7763-4f0c-a54b-4b1c87fe312d None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:26.607764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc76d1a-7763-4f0c-a54b-4b1c87fe312d None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:26.608051 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc76d1a-7763-4f0c-a54b-4b1c87fe312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:26.627835 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9cc76d1a-7763-4f0c-a54b-4b1c87fe312d None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:26.629064 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9cc76d1a-7763-4f0c-a54b-4b1c87fe312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:26.644919 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1287/2610] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jul 26 08:30:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:30:26.651696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:26.665052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcd867-6a8a-45a8-8381-d71de7fcf463 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:26.670313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6a56-0e3b-4e2a-bdf3-6a49e5b2b3d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:26.670871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6a56-0e3b-4e2a-bdf3-6a49e5b2b3d2 service swift] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:26.671179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6a56-0e3b-4e2a-bdf3-6a49e5b2b3d2 service swift] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:26.671455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6a56-0e3b-4e2a-bdf3-6a49e5b2b3d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:26.681560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6a56-0e3b-4e2a-bdf3-6a49e5b2b3d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:26.683155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6a56-0e3b-4e2a-bdf3-6a49e5b2b3d2 service swift] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:26.692402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1324/2611] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 08:30:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 08:30:31.486760 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc76d1a-7763-4f0c-a54b-4b1c87fe312d None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:31.488850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9cc76d1a-7763-4f0c-a54b-4b1c87fe312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:31.557320 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc76d1a-7763-4f0c-a54b-4b1c87fe312d None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:31.563306 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:31.564164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:31.564598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:31.565719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] PATH_INFO: `/v3/users/d31285002f5f462bb9ad8fb9f7ea70fd` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:31.567762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31285002f5f462bb9ad8fb9f7ea70fd)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:31.570135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:31.644199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31285002f5f462bb9ad8fb9f7ea70fd'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:31.657214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31285002f5f462bb9ad8fb9f7ea70fd'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:31.657953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31285002f5f462bb9ad8fb9f7ea70fd'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:31.681495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31285002f5f462bb9ad8fb9f7ea70fd'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:31.682322 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31285002f5f462bb9ad8fb9f7ea70fd'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:31.698496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1288/2612] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:30:31 2022] DELETE /identity/v3/users/d31285002f5f462bb9ad8fb9f7ea70fd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:30:31.703007 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fcf9f-2291-4ad1-9e2e-3bf0dd62458e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:31.703519 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fcf9f-2291-4ad1-9e2e-3bf0dd62458e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:31.703640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fcf9f-2291-4ad1-9e2e-3bf0dd62458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:31.722983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-f04fcf9f-2291-4ad1-9e2e-3bf0dd62458e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:30:31.724201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f04fcf9f-2291-4ad1-9e2e-3bf0dd62458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:31.822570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1325/2613] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:30:31.833961 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:31.836188 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:31.904914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e582-f1ee-42a3-8863-191d219fbdb3 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:31.908528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694902-9cd1-4e41-89f9-be858d8ebeee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:31.909153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694902-9cd1-4e41-89f9-be858d8ebeee service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:31.909439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694902-9cd1-4e41-89f9-be858d8ebeee service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:31.910236 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694902-9cd1-4e41-89f9-be858d8ebeee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:31.917551 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:31.923351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85694902-9cd1-4e41-89f9-be858d8ebeee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:31.931007 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85694902-9cd1-4e41-89f9-be858d8ebeee service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:31.953220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1289/2614] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:30:32.364064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fcf9f-2291-4ad1-9e2e-3bf0dd62458e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:32.365538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f04fcf9f-2291-4ad1-9e2e-3bf0dd62458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:32.377860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fcf9f-2291-4ad1-9e2e-3bf0dd62458e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:32.392502 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:32.393412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:32.394552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:32.395052 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] PATH_INFO: `/v3/projects/ac4e21b1e94043389a16f4800fb905af` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:32.397059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4e21b1e94043389a16f4800fb905af)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:32.399282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:32.407010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:32.450070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4e21b1e94043389a16f4800fb905af', 'request_id': 'req-10766a59-76a3-4270-9bd4-065c089c07d3'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:32.457962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4e21b1e94043389a16f4800fb905af', 'request_id': 'req-10766a59-76a3-4270-9bd4-065c089c07d3'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:32.463539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4e21b1e94043389a16f4800fb905af', 'request_id': 'req-10766a59-76a3-4270-9bd4-065c089c07d3'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:32.474287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] The token cache is being invalidate because project ac4e21b1e94043389a16f4800fb905af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:30:32.474572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:32.475222 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:30:32.476714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1326/2615] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:30:32 2022] DELETE /identity/v3/projects/ac4e21b1e94043389a16f4800fb905af => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:30:40.465796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694902-9cd1-4e41-89f9-be858d8ebeee service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:40.474744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694902-9cd1-4e41-89f9-be858d8ebeee service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:40.523481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:40.524154 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:40.524456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:40.524720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:40.526475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:40.535916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:40.537335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:40.545184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1290/2616] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:30:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:30:42.471288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:50.541667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=28 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:30:59.786753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:30:59.788790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:59.800829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10766a59-76a3-4270-9bd4-065c089c07d3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:30:59.804844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:30:59.805453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:30:59.805735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:30:59.806010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:30:59.807753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:30:59.870324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:30:59.871795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:30:59.881802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1327/2617] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:30:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:31:01.687339 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:31:01.688935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:31:01.786334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9daa3-2c89-49ab-a506-18fc74e572b7 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:31:01.792772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:31:01.793422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:31:01.793704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:31:01.793978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:31:01.795943 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:31:01.810291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:31:01.812142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:31:01.823842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1291/2618] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:31:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:31:09.876927 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=30 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:31:11.818661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=34 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:31:40.147811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:31:40.149720 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:31:40.248614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1541b0-a6a6-4a52-a721-cd0ee4b2cc46 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:31:40.253569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:31:40.254176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:31:40.254454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:31:40.254725 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:31:40.256482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:31:40.267505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:31:40.269059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:31:40.279212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1328/2619] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:31:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:31:50.275105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=45 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:14.161743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:14.209864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518fec7-e755-4913-b20f-b55a85dd51e6 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:14.214575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:14.215241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:14.215531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:14.215809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:14.217808 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:14.297206 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:14.298564 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:14.308588 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1292/2620] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:33:17.886977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:17.898249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:17.925011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d3f2-de88-4956-8e28-b91b733c5813 service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:17.929537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:17.930204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:17.930490 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:17.930768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] PATH_INFO: `/v3/users/19beebc60ea348c0b09cdb926218ce6f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:17.931995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19beebc60ea348c0b09cdb926218ce6f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:17.933901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:17.980560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19beebc60ea348c0b09cdb926218ce6f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:17.989105 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19beebc60ea348c0b09cdb926218ce6f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:17.996977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19beebc60ea348c0b09cdb926218ce6f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:17.997768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19beebc60ea348c0b09cdb926218ce6f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:18.011285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-d3767aba-3cdd-4c0e-bde8-1b16add4f519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19beebc60ea348c0b09cdb926218ce6f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:18.017409 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1329/2621] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:33:17 2022] DELETE /identity/v3/users/19beebc60ea348c0b09cdb926218ce6f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:18.189140 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:18.202712 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5c88-bbad-41ee-8db2-b00417003ee0 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:18.261721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:18.262367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.262647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.262946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] PATH_INFO: `/v3/projects/689fd1e7c85043b5b46df3dca883b9e9` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.264135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689fd1e7c85043b5b46df3dca883b9e9)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:18.266048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:18.312788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689fd1e7c85043b5b46df3dca883b9e9', 'request_id': 'req-b0fce400-4f0e-47bf-a12e-c3c785548c17'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:18.320010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689fd1e7c85043b5b46df3dca883b9e9', 'request_id': 'req-b0fce400-4f0e-47bf-a12e-c3c785548c17'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:18.328642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689fd1e7c85043b5b46df3dca883b9e9', 'request_id': 'req-b0fce400-4f0e-47bf-a12e-c3c785548c17'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:18.330052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:18.342301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] The token cache is being invalidate because project 689fd1e7c85043b5b46df3dca883b9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:33:18.342602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:18.343253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b0fce400-4f0e-47bf-a12e-c3c785548c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:18.344790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1293/2622] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:33:18 2022] DELETE /identity/v3/projects/689fd1e7c85043b5b46df3dca883b9e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:18.350805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b3bde-97a9-4fb4-8068-339d978d65e7 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.351167 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b3bde-97a9-4fb4-8068-339d978d65e7 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.351461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b3bde-97a9-4fb4-8068-339d978d65e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.371802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-e72b3bde-97a9-4fb4-8068-339d978d65e7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:18.372930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e72b3bde-97a9-4fb4-8068-339d978d65e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:18.440842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1330/2623] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:33:18.449741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806448a-c176-4e2e-b218-9a905a0bbb35 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.450035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806448a-c176-4e2e-b218-9a905a0bbb35 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.450316 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806448a-c176-4e2e-b218-9a905a0bbb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.471614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-5806448a-c176-4e2e-b218-9a905a0bbb35 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:18.472920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5806448a-c176-4e2e-b218-9a905a0bbb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:18.485213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1294/2624] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:33:18.486283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b3bde-97a9-4fb4-8068-339d978d65e7 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:18.497048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b3bde-97a9-4fb4-8068-339d978d65e7 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:18.501809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:18.502424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.502704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.503000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.503699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:33:18.504002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:18.505632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:18.518065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1331/2625] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:33:18.522838 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806448a-c176-4e2e-b218-9a905a0bbb35 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:18.534393 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806448a-c176-4e2e-b218-9a905a0bbb35 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:18.538480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb621cf-893f-4fe8-8931-bfe7a57df289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:18.539132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb621cf-893f-4fe8-8931-bfe7a57df289 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.539446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb621cf-893f-4fe8-8931-bfe7a57df289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.539718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb621cf-893f-4fe8-8931-bfe7a57df289 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.540379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb621cf-893f-4fe8-8931-bfe7a57df289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:18.542962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb621cf-893f-4fe8-8931-bfe7a57df289 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:18.574965 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1295/2626] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:33:18 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:33:18.577455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:18.587866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2482a4-fa3e-4c63-9f03-d95a6121fd8d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:18.635875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:18.652001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf0f5-b1d6-494c-9ae1-ac91eaf16630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:18.652625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf0f5-b1d6-494c-9ae1-ac91eaf16630 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.652906 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf0f5-b1d6-494c-9ae1-ac91eaf16630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.653182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdf0f5-b1d6-494c-9ae1-ac91eaf16630 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.653864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdf0f5-b1d6-494c-9ae1-ac91eaf16630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:18.656008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdf0f5-b1d6-494c-9ae1-ac91eaf16630 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:18.679736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1332/2627] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:33:18 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:33:18.684493 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb621cf-893f-4fe8-8931-bfe7a57df289 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:18.695402 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb621cf-893f-4fe8-8931-bfe7a57df289 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:18.700199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7514-625a-47f3-8efa-393c569f778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:18.700817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7514-625a-47f3-8efa-393c569f778c admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.701101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7514-625a-47f3-8efa-393c569f778c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.701384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7514-625a-47f3-8efa-393c569f778c admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.702078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d7514-625a-47f3-8efa-393c569f778c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:18.703704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d7514-625a-47f3-8efa-393c569f778c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:18.714689 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1296/2628] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:33:18.718536 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf0f5-b1d6-494c-9ae1-ac91eaf16630 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:18.729956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdf0f5-b1d6-494c-9ae1-ac91eaf16630 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:18.735679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ee0aa-1a2d-48aa-8c96-dd92f2f8ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:18.736935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ee0aa-1a2d-48aa-8c96-dd92f2f8ad3f admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.737260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ee0aa-1a2d-48aa-8c96-dd92f2f8ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.737515 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ee0aa-1a2d-48aa-8c96-dd92f2f8ad3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.738370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ee0aa-1a2d-48aa-8c96-dd92f2f8ad3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:18.740026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ee0aa-1a2d-48aa-8c96-dd92f2f8ad3f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:18.751989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1333/2629] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:33:18.756338 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7514-625a-47f3-8efa-393c569f778c admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:18.766822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7514-625a-47f3-8efa-393c569f778c admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:18.771652 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:18.772361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.772648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.772928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] PATH_INFO: `/v3/projects/f829e581f6414c788ad1193f9168c3ab/users/24658f68ae194ce3a9ecdce7fdead2b9/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.918178 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f829e581f6414c788ad1193f9168c3ab, user_id=24658f68ae194ce3a9ecdce7fdead2b9, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:18.920873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:18.937252 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1297/2630] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:33:18 2022] PUT /identity/v3/projects/f829e581f6414c788ad1193f9168c3ab/users/24658f68ae194ce3a9ecdce7fdead2b9/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:18.942971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8db6b-bae4-45ca-84f3-4be289ece902 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:18.943832 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8db6b-bae4-45ca-84f3-4be289ece902 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:18.944120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8db6b-bae4-45ca-84f3-4be289ece902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:18.964108 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4af8db6b-bae4-45ca-84f3-4be289ece902 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:18.965438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4af8db6b-bae4-45ca-84f3-4be289ece902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:19.031645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1334/2631] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:33:19.041440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:19.043227 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:19.098688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f016fc8-eb4d-4161-9d0b-a40d587fb6de admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:19.103005 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:19.103611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:19.103885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:19.104155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:19.112936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:19.114351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:19.123925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1298/2632] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:33:19.865476 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3af06-c148-4cfb-a45f-c90d2987c6d6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:19.866017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3af06-c148-4cfb-a45f-c90d2987c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:19.866505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3af06-c148-4cfb-a45f-c90d2987c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:19.893016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-73e3af06-c148-4cfb-a45f-c90d2987c6d6 None None] MFA Rules not processed for user `a6d078f161bc415ca00848947b9cd947`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:19.894405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-73e3af06-c148-4cfb-a45f-c90d2987c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:19.971139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1335/2633] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jul 26 08:33:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:33:20.040817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:20.043136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:20.131146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf405be3-c974-41b9-82ae-02a950c24850 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:20.137307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de1dd35abd2e4db0bda795191eeee287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:20.137956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:20.138234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:20.138502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:20.147505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:20.149106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:20.158229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1299/2634] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jul 26 08:33:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 08:33:24.215802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2ebb-909e-4198-8feb-034ceb3157dd None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:24.217213 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2ebb-909e-4198-8feb-034ceb3157dd None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:24.217749 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2ebb-909e-4198-8feb-034ceb3157dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:24.266670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a82b2ebb-909e-4198-8feb-034ceb3157dd None None] MFA Rules not processed for user `24658f68ae194ce3a9ecdce7fdead2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:24.267764 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a82b2ebb-909e-4198-8feb-034ceb3157dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:24.347166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:24.379417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1336/2635] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:33:24.394382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:24.395960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:24.424411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:24.510651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd473cb-b219-499d-9d7f-963dce735e71 service swift] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:24.517568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:24.519266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:24.519266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:24.519702 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:24.535197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:24.537624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:24.559331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1300/2636] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:33:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:33:26.931327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e29501-fe55-4b60-9d70-0f7ccf17f6d6 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:26.931842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e29501-fe55-4b60-9d70-0f7ccf17f6d6 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:26.932033 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e29501-fe55-4b60-9d70-0f7ccf17f6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:26.951995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-12e29501-fe55-4b60-9d70-0f7ccf17f6d6 None None] MFA Rules not processed for user `24658f68ae194ce3a9ecdce7fdead2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:26.953580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-12e29501-fe55-4b60-9d70-0f7ccf17f6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:26.967823 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1337/2637] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:33:29.402909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:29.404572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:29.421481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf4be-b29c-49fc-9fc1-38e810d8f42c service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:29.426230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:29.426964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:29.427266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:29.427540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] PATH_INFO: `/v3/users/5bec38b5d16647bab07d4ad06ab0f094` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:29.428714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bec38b5d16647bab07d4ad06ab0f094)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:29.431379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:29.483581 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bec38b5d16647bab07d4ad06ab0f094'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.491118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bec38b5d16647bab07d4ad06ab0f094'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.492048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bec38b5d16647bab07d4ad06ab0f094'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.504936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bec38b5d16647bab07d4ad06ab0f094'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.505597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bec38b5d16647bab07d4ad06ab0f094'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.518232 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1301/2638] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:33:29 2022] DELETE /identity/v3/users/5bec38b5d16647bab07d4ad06ab0f094 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:29.687647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e29501-fe55-4b60-9d70-0f7ccf17f6d6 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:29.698901 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e29501-fe55-4b60-9d70-0f7ccf17f6d6 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:29.773076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:29.774504 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:29.774788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:29.775100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] PATH_INFO: `/v3/projects/a7631e3db11f429d80138098922305f0` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:29.776282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7631e3db11f429d80138098922305f0)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:29.778348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:29.826421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7631e3db11f429d80138098922305f0', 'request_id': 'req-71e506e3-45a5-4589-b960-0cb84040f08b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.836691 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7631e3db11f429d80138098922305f0', 'request_id': 'req-71e506e3-45a5-4589-b960-0cb84040f08b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.851312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7631e3db11f429d80138098922305f0', 'request_id': 'req-71e506e3-45a5-4589-b960-0cb84040f08b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.863553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] The token cache is being invalidate because project a7631e3db11f429d80138098922305f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:33:29.863772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.864424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.866066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1338/2639] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:33:29 2022] DELETE /identity/v3/projects/a7631e3db11f429d80138098922305f0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:29.870254 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:29.871686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:29.884834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ada9-cd79-4759-86c4-f01e79528554 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:29.941472 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:29.942111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:29.942390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:29.942662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] PATH_INFO: `/v3/users/890294f9bbb0439498b2d44d67f84a04` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:29.943865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890294f9bbb0439498b2d44d67f84a04)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:29.946266 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:29.951461 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:29.992842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890294f9bbb0439498b2d44d67f84a04'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:29.999835 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890294f9bbb0439498b2d44d67f84a04'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.000489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890294f9bbb0439498b2d44d67f84a04'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.012800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890294f9bbb0439498b2d44d67f84a04'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.013441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-deff0f35-3c60-47e8-aaa6-8833a72f4671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890294f9bbb0439498b2d44d67f84a04'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.026177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1302/2640] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:33:29 2022] DELETE /identity/v3/users/890294f9bbb0439498b2d44d67f84a04 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:33:30.194597 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:30.196611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:30.210493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e506e3-45a5-4589-b960-0cb84040f08b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:30.270448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:30.271122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.271397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.271664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] PATH_INFO: `/v3/projects/f01d12092c1649daa99d4d2f72e135c6` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.272805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01d12092c1649daa99d4d2f72e135c6)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:30.275366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:30.295276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:30.321926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01d12092c1649daa99d4d2f72e135c6', 'request_id': 'req-40bc272e-6040-47e5-9c68-e0fbf20ee253'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.328920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01d12092c1649daa99d4d2f72e135c6', 'request_id': 'req-40bc272e-6040-47e5-9c68-e0fbf20ee253'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.334329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01d12092c1649daa99d4d2f72e135c6', 'request_id': 'req-40bc272e-6040-47e5-9c68-e0fbf20ee253'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.344890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] The token cache is being invalidate because project f01d12092c1649daa99d4d2f72e135c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:33:30.345177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.345790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-40bc272e-6040-47e5-9c68-e0fbf20ee253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:33:30.347437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1339/2641] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:33:30 2022] DELETE /identity/v3/projects/f01d12092c1649daa99d4d2f72e135c6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:30.352370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3573e-97ab-4d16-9bda-723ca8558eeb None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.352651 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3573e-97ab-4d16-9bda-723ca8558eeb None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.352926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3573e-97ab-4d16-9bda-723ca8558eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.372490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-4ea3573e-97ab-4d16-9bda-723ca8558eeb None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:30.373614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4ea3573e-97ab-4d16-9bda-723ca8558eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:30.431324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1303/2642] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:33:30.439346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b999-fa21-40a2-ab72-ffe5eaefd624 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.439655 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b999-fa21-40a2-ab72-ffe5eaefd624 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.439900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b999-fa21-40a2-ab72-ffe5eaefd624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.459677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-e8b7b999-fa21-40a2-ab72-ffe5eaefd624 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:30.460876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e8b7b999-fa21-40a2-ab72-ffe5eaefd624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:30.469529 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1340/2643] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:33:30.473649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3573e-97ab-4d16-9bda-723ca8558eeb None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:30.483329 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3573e-97ab-4d16-9bda-723ca8558eeb None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:30.487890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:30.488496 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.488778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.489052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.489750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:33:30.490053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:30.491690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:30.503734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1304/2644] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 08:33:30.508539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7b999-fa21-40a2-ab72-ffe5eaefd624 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:30.517925 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7b999-fa21-40a2-ab72-ffe5eaefd624 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:30.522558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9339f5-3e5f-4f7e-89ca-fcfa1a67f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:30.523198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9339f5-3e5f-4f7e-89ca-fcfa1a67f1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.523481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9339f5-3e5f-4f7e-89ca-fcfa1a67f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.523760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9339f5-3e5f-4f7e-89ca-fcfa1a67f1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.524430 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9339f5-3e5f-4f7e-89ca-fcfa1a67f1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:30.526316 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9339f5-3e5f-4f7e-89ca-fcfa1a67f1e3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:30.553675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1341/2645] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:33:30 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:33:30.558417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:30.568348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424adc5f-7398-42d8-9ed0-ee94c36955b8 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:30.624721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3b88-e2dd-4326-bc1f-a20c2b99c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:30.625255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3b88-e2dd-4326-bc1f-a20c2b99c899 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.625531 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3b88-e2dd-4326-bc1f-a20c2b99c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.625798 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3b88-e2dd-4326-bc1f-a20c2b99c899 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.626457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3b88-e2dd-4326-bc1f-a20c2b99c899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:30.628361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3b88-e2dd-4326-bc1f-a20c2b99c899 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:30.649223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1305/2646] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:33:30 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:33:30.653318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9339f5-3e5f-4f7e-89ca-fcfa1a67f1e3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:30.663840 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9339f5-3e5f-4f7e-89ca-fcfa1a67f1e3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:30.668945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82f438-9c51-4859-88e3-a0990cbc6134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:30.669555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82f438-9c51-4859-88e3-a0990cbc6134 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.669841 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82f438-9c51-4859-88e3-a0990cbc6134 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.670117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82f438-9c51-4859-88e3-a0990cbc6134 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.670846 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82f438-9c51-4859-88e3-a0990cbc6134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:30.672512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82f438-9c51-4859-88e3-a0990cbc6134 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:30.682947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1342/2647] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:33:30.686729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3b88-e2dd-4326-bc1f-a20c2b99c899 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:30.691968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:30.698214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3b88-e2dd-4326-bc1f-a20c2b99c899 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:30.703811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc36b-e5c4-4d63-8c2d-cd615b8ad7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:30.704423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc36b-e5c4-4d63-8c2d-cd615b8ad7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.704703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc36b-e5c4-4d63-8c2d-cd615b8ad7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.704975 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc36b-e5c4-4d63-8c2d-cd615b8ad7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.705676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fc36b-e5c4-4d63-8c2d-cd615b8ad7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:30.707301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fc36b-e5c4-4d63-8c2d-cd615b8ad7d0 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:30.717212 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1306/2648] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:33:30.721227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82f438-9c51-4859-88e3-a0990cbc6134 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:30.731826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82f438-9c51-4859-88e3-a0990cbc6134 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:30.736376 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:30.737026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.737306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.737583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] PATH_INFO: `/v3/projects/fc7e7a28f7c24dae9252a0afc9233ba3/users/ac3dcec2976f433cbf562f4c30f72a35/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.753921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e7a28f7c24dae9252a0afc9233ba3, user_id=ac3dcec2976f433cbf562f4c30f72a35, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:30.756608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:30.770678 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1343/2649] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:33:30 2022] PUT /identity/v3/projects/fc7e7a28f7c24dae9252a0afc9233ba3/users/ac3dcec2976f433cbf562f4c30f72a35/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:30.775903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0b21f-a1b7-497c-96da-6d2fa92b3a9a None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.776210 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0b21f-a1b7-497c-96da-6d2fa92b3a9a None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.776490 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0b21f-a1b7-497c-96da-6d2fa92b3a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.795359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-aaa0b21f-a1b7-497c-96da-6d2fa92b3a9a None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:30.796673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-aaa0b21f-a1b7-497c-96da-6d2fa92b3a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:30.858468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1307/2650] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:33:30.872034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:30.873737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:30.945106 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af156a4-b19f-4340-aee7-200b6269ce82 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:30.948979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ad4b4-de31-4a35-a0af-86fe74a037bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:30.949570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad4b4-de31-4a35-a0af-86fe74a037bf service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:30.949855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad4b4-de31-4a35-a0af-86fe74a037bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:30.950132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad4b4-de31-4a35-a0af-86fe74a037bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:30.961618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ad4b4-de31-4a35-a0af-86fe74a037bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:30.962747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ad4b4-de31-4a35-a0af-86fe74a037bf service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:30.975348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1344/2651] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:33:35.186834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb719b5-8862-4bb5-978d-0e45ab7fcab4 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:35.187391 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb719b5-8862-4bb5-978d-0e45ab7fcab4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:35.187500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb719b5-8862-4bb5-978d-0e45ab7fcab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:35.228964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-1cb719b5-8862-4bb5-978d-0e45ab7fcab4 None None] MFA Rules not processed for user `ac3dcec2976f433cbf562f4c30f72a35`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:35.230253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-1cb719b5-8862-4bb5-978d-0e45ab7fcab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:35.359092 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1308/2652] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:33:35.361233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ad4b4-de31-4a35-a0af-86fe74a037bf service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:35.375201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ad4b4-de31-4a35-a0af-86fe74a037bf service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:35.383636 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569246f4-e79a-4ef0-bc36-677417593603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:35.384261 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569246f4-e79a-4ef0-bc36-677417593603 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:35.384552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569246f4-e79a-4ef0-bc36-677417593603 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:35.384829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569246f4-e79a-4ef0-bc36-677417593603 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:35.385516 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569246f4-e79a-4ef0-bc36-677417593603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:35.387467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569246f4-e79a-4ef0-bc36-677417593603 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:35.434843 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1345/2653] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:33:35 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:33:35.436026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb719b5-8862-4bb5-978d-0e45ab7fcab4 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:35.454875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb719b5-8862-4bb5-978d-0e45ab7fcab4 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:35.539967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9549a-2c6c-4956-8f61-268368922b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:35.540621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9549a-2c6c-4956-8f61-268368922b7b admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:35.542535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9549a-2c6c-4956-8f61-268368922b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:35.542752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9549a-2c6c-4956-8f61-268368922b7b admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:35.544587 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9549a-2c6c-4956-8f61-268368922b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:35.546957 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9549a-2c6c-4956-8f61-268368922b7b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:35.578862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1309/2654] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:33:35 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:33:35.579935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569246f4-e79a-4ef0-bc36-677417593603 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:35.596997 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569246f4-e79a-4ef0-bc36-677417593603 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:35.605859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c694-352c-4108-b2da-75037648a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:35.606995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c694-352c-4108-b2da-75037648a4ce admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:35.607600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c694-352c-4108-b2da-75037648a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:35.608412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c694-352c-4108-b2da-75037648a4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:35.609363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c694-352c-4108-b2da-75037648a4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:35.611783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c694-352c-4108-b2da-75037648a4ce admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:35.632731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1346/2655] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:33:35.636994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9549a-2c6c-4956-8f61-268368922b7b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:35.648276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9549a-2c6c-4956-8f61-268368922b7b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:35.654640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5dd0-4a28-4bcb-bf84-36b9772430f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:35.655483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5dd0-4a28-4bcb-bf84-36b9772430f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:35.655870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5dd0-4a28-4bcb-bf84-36b9772430f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:35.656285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5dd0-4a28-4bcb-bf84-36b9772430f9 admin admin] PATH_INFO: `/v3/projects/3b1235c1ee6b454687cb8daa5127324b/users/3277243733e34802bf732c356a57c831/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:35.671910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:35.685405 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad5dd0-4a28-4bcb-bf84-36b9772430f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1235c1ee6b454687cb8daa5127324b, user_id=3277243733e34802bf732c356a57c831, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:35.689721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad5dd0-4a28-4bcb-bf84-36b9772430f9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:35.715452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c694-352c-4108-b2da-75037648a4ce admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:35.716325 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1310/2656] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:33:35 2022] PUT /identity/v3/projects/3b1235c1ee6b454687cb8daa5127324b/users/3277243733e34802bf732c356a57c831/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:35.730275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c694-352c-4108-b2da-75037648a4ce admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:35.749643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:35.837571 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f06cd-580c-4f44-ad45-c0de3b15ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:35.838296 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f06cd-580c-4f44-ad45-c0de3b15ef15 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:35.838589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f06cd-580c-4f44-ad45-c0de3b15ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:35.838868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f06cd-580c-4f44-ad45-c0de3b15ef15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:35.840353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f06cd-580c-4f44-ad45-c0de3b15ef15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:35.844114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f06cd-580c-4f44-ad45-c0de3b15ef15 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:35.857421 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1347/2657] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:33:35.859281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5dd0-4a28-4bcb-bf84-36b9772430f9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:35.876291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5dd0-4a28-4bcb-bf84-36b9772430f9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:35.889416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:35.891068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:35.893222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:35.893777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] PATH_INFO: `/v3/projects/3b1235c1ee6b454687cb8daa5127324b/users/3277243733e34802bf732c356a57c831/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:35.895840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1235c1ee6b454687cb8daa5127324b, user_id=3277243733e34802bf732c356a57c831, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:35.899403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:35.915412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1311/2658] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:33:35 2022] PUT /identity/v3/projects/3b1235c1ee6b454687cb8daa5127324b/users/3277243733e34802bf732c356a57c831/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:33:38.278250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f06cd-580c-4f44-ad45-c0de3b15ef15 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:38.354766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f06cd-580c-4f44-ad45-c0de3b15ef15 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:38.446073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd3236-08ac-44ac-9c39-6567ee712bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:38.446351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd3236-08ac-44ac-9c39-6567ee712bca service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:38.446754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd3236-08ac-44ac-9c39-6567ee712bca service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:38.447226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd3236-08ac-44ac-9c39-6567ee712bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:38.454732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7acd3236-08ac-44ac-9c39-6567ee712bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:38.574122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd3236-08ac-44ac-9c39-6567ee712bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:38.576116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd3236-08ac-44ac-9c39-6567ee712bca service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:38.602620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1348/2659] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:33:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:33:39.920942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:39.922828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:39.946602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d31206-6077-4089-a294-0ec3c867451b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:39.957390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:39.958027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:39.958459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:39.958912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:39.964607 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:39.996157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:39.998185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:40.017986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1312/2660] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:33:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:33:41.497163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d822481-4a98-488e-af52-7b150180d139 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:41.497648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d822481-4a98-488e-af52-7b150180d139 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:41.497737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d822481-4a98-488e-af52-7b150180d139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:41.515589 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:41.530498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-1d822481-4a98-488e-af52-7b150180d139 None None] MFA Rules not processed for user `3277243733e34802bf732c356a57c831`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:41.531903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1d822481-4a98-488e-af52-7b150180d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:41.624806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1349/2661] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:33:41.643469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:41.645293 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:41.659676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c6015-def6-484b-b15d-4f2f04b654e4 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:41.665363 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45fd16-ec7d-462b-9a93-1bc86720456d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:41.666063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45fd16-ec7d-462b-9a93-1bc86720456d service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:41.666419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45fd16-ec7d-462b-9a93-1bc86720456d service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:41.666763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45fd16-ec7d-462b-9a93-1bc86720456d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:41.728942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45fd16-ec7d-462b-9a93-1bc86720456d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:41.730441 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45fd16-ec7d-462b-9a93-1bc86720456d service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:41.740249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1313/2662] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:33:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:33:42.812885 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a21e2-77a6-4c3c-90aa-0c8bddf89eed None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:42.813386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a21e2-77a6-4c3c-90aa-0c8bddf89eed None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:42.813490 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a21e2-77a6-4c3c-90aa-0c8bddf89eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:42.833275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3b3a21e2-77a6-4c3c-90aa-0c8bddf89eed None None] MFA Rules not processed for user `ac3dcec2976f433cbf562f4c30f72a35`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:33:42.834458 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3b3a21e2-77a6-4c3c-90aa-0c8bddf89eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:42.842002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1350/2663] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:33:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:33:46.255914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45fd16-ec7d-462b-9a93-1bc86720456d service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:33:46.267487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45fd16-ec7d-462b-9a93-1bc86720456d service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:33:46.273011 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:33:46.273634 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:33:46.273922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:33:46.274203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:33:46.275993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:33:46.288661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:33:46.290223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:33:46.301474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1314/2664] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:33:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:33:52.827390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=34 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:33:56.296676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:09.894475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a21e2-77a6-4c3c-90aa-0c8bddf89eed None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:09.903928 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a21e2-77a6-4c3c-90aa-0c8bddf89eed None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:09.907415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:09.908013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:09.908289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:09.908559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:09.910265 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:09.919950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:09.921360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:09.930187 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1351/2665] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:10.361244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:10.362686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:10.434763 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad16725-e12a-4566-a8ac-ab75119e9180 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:10.439744 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:10.440356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:10.440639 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:10.440913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:10.442662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:10.454228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:10.455834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:10.466238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1315/2666] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:19.926058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:20.461350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=32 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:24.436775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:24.451896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592c195-0a9c-4792-b4b8-4720226b7fae service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:24.457259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:24.457909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:24.458194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:24.458472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:24.460273 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:24.473509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:24.475115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:24.486307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1352/2667] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:26.959065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:26.968242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2c32-cc5e-4cf0-8683-28e8b38d9f42 service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:26.971804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fb263-894e-40ff-bb04-26c0838337d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:26.972409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fb263-894e-40ff-bb04-26c0838337d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:26.972694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fb263-894e-40ff-bb04-26c0838337d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:26.972972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fb263-894e-40ff-bb04-26c0838337d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:26.982262 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fb263-894e-40ff-bb04-26c0838337d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:26.983713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fb263-894e-40ff-bb04-26c0838337d7 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:26.993263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1316/2668] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:34.481953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:36.322681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:36.324667 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:36.388475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508c24-b772-44ce-933f-4102f6d9a325 service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:36.392051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:36.392657 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:36.392937 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:36.393211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:36.394948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:36.452787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:36.454212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:36.463143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1353/2669] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:36.988973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:38.691415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fb263-894e-40ff-bb04-26c0838337d7 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:38.699946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fb263-894e-40ff-bb04-26c0838337d7 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:38.703518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:38.704114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:38.704392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:38.704665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:38.706403 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:38.767467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:38.768891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:38.778839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1317/2670] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:42.204569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:42.206000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:42.220772 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8a7e8-3086-48bb-9dcc-92f10f9cef1d service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:42.225718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:42.226332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:42.226608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:42.227308 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:42.228670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:42.241288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:42.243276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:42.254872 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1354/2671] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:42.261625 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:42.263265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:42.278058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fcc53-aae5-4f21-9893-14e669239932 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:42.289242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:42.289242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:42.289242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:42.289242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] PATH_INFO: `/v3/users/c42352a47bf04dadaa592a4b18fc2340` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:42.290044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42352a47bf04dadaa592a4b18fc2340)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:42.290044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:42.334194 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42352a47bf04dadaa592a4b18fc2340'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.341825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42352a47bf04dadaa592a4b18fc2340'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.342483 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42352a47bf04dadaa592a4b18fc2340'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.355182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42352a47bf04dadaa592a4b18fc2340'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.355812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-91073da5-8726-4ec1-826a-bc8527261669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42352a47bf04dadaa592a4b18fc2340'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.369365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1318/2672] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:34:42 2022] DELETE /identity/v3/users/c42352a47bf04dadaa592a4b18fc2340 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:42.536324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:42.547988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22dda-83c6-4027-948a-4db7b697cd64 service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:42.604405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:42.605055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:42.605336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:42.605614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] PATH_INFO: `/v3/projects/1b8b3351fbf14d3385d0287f41c23025` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:42.615744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8b3351fbf14d3385d0287f41c23025)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:42.617652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:42.648038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:42.665630 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8b3351fbf14d3385d0287f41c23025', 'request_id': 'req-286ac706-340a-4760-9b38-f317e03564e7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.672819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8b3351fbf14d3385d0287f41c23025', 'request_id': 'req-286ac706-340a-4760-9b38-f317e03564e7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.678370 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8b3351fbf14d3385d0287f41c23025', 'request_id': 'req-286ac706-340a-4760-9b38-f317e03564e7'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.689732 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] The token cache is being invalidate because project 1b8b3351fbf14d3385d0287f41c23025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:34:42.690019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.690744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-286ac706-340a-4760-9b38-f317e03564e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:42.692280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1355/2673] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:34:42 2022] DELETE /identity/v3/projects/1b8b3351fbf14d3385d0287f41c23025 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:42.699310 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003edf8-aa4d-44e3-9a25-901f4f143a67 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:42.699603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003edf8-aa4d-44e3-9a25-901f4f143a67 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:42.699883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003edf8-aa4d-44e3-9a25-901f4f143a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:42.720290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-7003edf8-aa4d-44e3-9a25-901f4f143a67 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:42.721512 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7003edf8-aa4d-44e3-9a25-901f4f143a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:42.779478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1319/2674] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:42.788313 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06265b3e-59f2-45cc-aec9-321355374331 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:42.788602 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06265b3e-59f2-45cc-aec9-321355374331 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:42.788878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06265b3e-59f2-45cc-aec9-321355374331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:42.808267 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-06265b3e-59f2-45cc-aec9-321355374331 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:42.809553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-06265b3e-59f2-45cc-aec9-321355374331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:42.818076 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1356/2675] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:42.822261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003edf8-aa4d-44e3-9a25-901f4f143a67 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:42.832420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003edf8-aa4d-44e3-9a25-901f4f143a67 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:42.837014 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:42.837621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:42.837904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:42.838179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:42.838953 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:34:42.839298 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:42.840893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:42.842672 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:42.858086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1320/2676] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:34:42.859270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06265b3e-59f2-45cc-aec9-321355374331 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:42.869244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06265b3e-59f2-45cc-aec9-321355374331 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:42.873987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e51d-273d-4ad4-9258-fbd61323e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:42.874592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e51d-273d-4ad4-9258-fbd61323e4fa admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:42.874875 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e51d-273d-4ad4-9258-fbd61323e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:42.875189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e51d-273d-4ad4-9258-fbd61323e4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:42.875895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7e51d-273d-4ad4-9258-fbd61323e4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:42.877791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7e51d-273d-4ad4-9258-fbd61323e4fa admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:42.905699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1357/2677] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:34:42 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:34:42.909883 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:42.919728 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332ec9-ac9b-4ee1-8756-0cfbaeac17e6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:42.972969 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7ff9-475a-4bbd-a747-d6e5072a6d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:42.973600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7ff9-475a-4bbd-a747-d6e5072a6d86 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:42.973880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7ff9-475a-4bbd-a747-d6e5072a6d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:42.974179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7ff9-475a-4bbd-a747-d6e5072a6d86 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:42.974839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7ff9-475a-4bbd-a747-d6e5072a6d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:42.976750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7ff9-475a-4bbd-a747-d6e5072a6d86 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:42.997578 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1321/2678] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:34:42 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:34:43.001680 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e51d-273d-4ad4-9258-fbd61323e4fa admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:43.012611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e51d-273d-4ad4-9258-fbd61323e4fa admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:43.017460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2f1a-8443-43c9-adce-3aa727df73a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:43.018071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2f1a-8443-43c9-adce-3aa727df73a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:43.018347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2f1a-8443-43c9-adce-3aa727df73a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:43.018614 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2f1a-8443-43c9-adce-3aa727df73a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:43.019329 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c2f1a-8443-43c9-adce-3aa727df73a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:43.021035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c2f1a-8443-43c9-adce-3aa727df73a2 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:43.030842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1358/2679] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:34:43.034592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7ff9-475a-4bbd-a747-d6e5072a6d86 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:43.044463 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7ff9-475a-4bbd-a747-d6e5072a6d86 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:43.048982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87150409-00e4-4926-94d7-cf854633b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:43.049574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150409-00e4-4926-94d7-cf854633b7ed admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:43.049862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150409-00e4-4926-94d7-cf854633b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:43.050135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87150409-00e4-4926-94d7-cf854633b7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:43.050822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87150409-00e4-4926-94d7-cf854633b7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:43.052417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87150409-00e4-4926-94d7-cf854633b7ed admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:43.063117 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1322/2680] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:34:43.066950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2f1a-8443-43c9-adce-3aa727df73a2 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:43.077428 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2f1a-8443-43c9-adce-3aa727df73a2 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:43.082064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:43.082702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:43.083090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:43.083373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] PATH_INFO: `/v3/projects/f45a72e016eb4cb389ad90e827c617de/users/20029dd94c0f4b32a71258e55b544d8b/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:43.097483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45a72e016eb4cb389ad90e827c617de, user_id=20029dd94c0f4b32a71258e55b544d8b, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:43.100152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:43.112811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1359/2681] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:43 2022] PUT /identity/v3/projects/f45a72e016eb4cb389ad90e827c617de/users/20029dd94c0f4b32a71258e55b544d8b/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:43.123572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bec1-fd2d-4e0b-bc47-7db57eb76ea3 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:43.123917 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bec1-fd2d-4e0b-bc47-7db57eb76ea3 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:43.124276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2bec1-fd2d-4e0b-bc47-7db57eb76ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:43.151618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-6fe2bec1-fd2d-4e0b-bc47-7db57eb76ea3 None None] MFA Rules not processed for user `20029dd94c0f4b32a71258e55b544d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:43.152848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-6fe2bec1-fd2d-4e0b-bc47-7db57eb76ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:43.215629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1323/2682] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:43.226023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:43.227736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:43.299870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2bcbb-8832-4e01-b35c-81c5c8d0617a admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:43.305299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf36dfb-7304-4dc8-90e6-11a5b04bd1c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:43.305903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf36dfb-7304-4dc8-90e6-11a5b04bd1c2 service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:43.306181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf36dfb-7304-4dc8-90e6-11a5b04bd1c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:43.306452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf36dfb-7304-4dc8-90e6-11a5b04bd1c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:43.314679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf36dfb-7304-4dc8-90e6-11a5b04bd1c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:43.316270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf36dfb-7304-4dc8-90e6-11a5b04bd1c2 service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:43.324819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1360/2683] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:52.677619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2bec1-fd2d-4e0b-bc47-7db57eb76ea3 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:52.738416 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2bec1-fd2d-4e0b-bc47-7db57eb76ea3 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:52.743181 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:52.743815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:52.744100 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:52.744375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] PATH_INFO: `/v3/users/20029dd94c0f4b32a71258e55b544d8b` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:52.745529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20029dd94c0f4b32a71258e55b544d8b)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:52.747473 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:52.749694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:52.793791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20029dd94c0f4b32a71258e55b544d8b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:52.801056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20029dd94c0f4b32a71258e55b544d8b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:52.801705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20029dd94c0f4b32a71258e55b544d8b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:52.813565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20029dd94c0f4b32a71258e55b544d8b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:52.814234 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20029dd94c0f4b32a71258e55b544d8b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:52.826880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1324/2684] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:34:52 2022] DELETE /identity/v3/users/20029dd94c0f4b32a71258e55b544d8b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:52.831358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad118f74-2e78-40b7-b04b-c25aea609916 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:52.831944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad118f74-2e78-40b7-b04b-c25aea609916 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:52.831944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad118f74-2e78-40b7-b04b-c25aea609916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:52.851624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ad118f74-2e78-40b7-b04b-c25aea609916 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:52.852824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ad118f74-2e78-40b7-b04b-c25aea609916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:52.883202 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:52.913280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1361/2685] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:52.923468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:52.924861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:52.979374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b9858-3878-4f5d-ae08-5ee0233a26e4 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:52.983616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bf5e1-39db-46c2-b465-5256af6b5cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:52.984223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bf5e1-39db-46c2-b465-5256af6b5cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:52.984500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bf5e1-39db-46c2-b465-5256af6b5cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:52.984774 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bf5e1-39db-46c2-b465-5256af6b5cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:52.993988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bf5e1-39db-46c2-b465-5256af6b5cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:52.995484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bf5e1-39db-46c2-b465-5256af6b5cf7 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.004966 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1325/2686] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:53.270407 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad118f74-2e78-40b7-b04b-c25aea609916 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:53.271947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ad118f74-2e78-40b7-b04b-c25aea609916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:53.284497 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad118f74-2e78-40b7-b04b-c25aea609916 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:53.289127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:53.289775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.290057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.290346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] PATH_INFO: `/v3/projects/f45a72e016eb4cb389ad90e827c617de` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.291549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45a72e016eb4cb389ad90e827c617de)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:53.293457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.342055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45a72e016eb4cb389ad90e827c617de', 'request_id': 'req-53d805e9-189a-4b9a-83b6-bbad366c9e57'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:53.349309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45a72e016eb4cb389ad90e827c617de', 'request_id': 'req-53d805e9-189a-4b9a-83b6-bbad366c9e57'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:53.354687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45a72e016eb4cb389ad90e827c617de', 'request_id': 'req-53d805e9-189a-4b9a-83b6-bbad366c9e57'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:53.365783 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] The token cache is being invalidate because project f45a72e016eb4cb389ad90e827c617de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:34:53.366073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:53.366708 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-53d805e9-189a-4b9a-83b6-bbad366c9e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:53.368478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1362/2687] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:34:53 2022] DELETE /identity/v3/projects/f45a72e016eb4cb389ad90e827c617de => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:53.374851 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d9aa-e58f-483c-8f6e-dc10065c3d83 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.375158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d9aa-e58f-483c-8f6e-dc10065c3d83 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.375434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4d9aa-e58f-483c-8f6e-dc10065c3d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.395278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-dfe4d9aa-e58f-483c-8f6e-dc10065c3d83 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:53.396480 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-dfe4d9aa-e58f-483c-8f6e-dc10065c3d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:53.454985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1326/2688] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:53.462796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b856d6-1b19-41b3-92b3-670fa5441fba None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.463115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b856d6-1b19-41b3-92b3-670fa5441fba None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.463386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b856d6-1b19-41b3-92b3-670fa5441fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.482201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c0b856d6-1b19-41b3-92b3-670fa5441fba None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:53.483422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c0b856d6-1b19-41b3-92b3-670fa5441fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:53.491112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1363/2689] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:53.495466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4d9aa-e58f-483c-8f6e-dc10065c3d83 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:53.505503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4d9aa-e58f-483c-8f6e-dc10065c3d83 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:53.510068 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:53.510670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.510981 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.511263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.511960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:34:53.512270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:53.514467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.525762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1327/2690] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:34:53.529847 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b856d6-1b19-41b3-92b3-670fa5441fba None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:53.538793 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b856d6-1b19-41b3-92b3-670fa5441fba None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:53.543394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30316-4c7d-4bf4-ab77-bfcb87a831ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:53.543990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30316-4c7d-4bf4-ab77-bfcb87a831ed admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.544264 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30316-4c7d-4bf4-ab77-bfcb87a831ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.544537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30316-4c7d-4bf4-ab77-bfcb87a831ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.545194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30316-4c7d-4bf4-ab77-bfcb87a831ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:53.547104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30316-4c7d-4bf4-ab77-bfcb87a831ed admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.573410 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1364/2691] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:34:53 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:34:53.578070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:53.587859 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093088-e349-4589-8718-75b40849a570 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:53.595571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:53.645002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139123a8-1f71-4d1e-a5da-9e5928a277de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:53.645542 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139123a8-1f71-4d1e-a5da-9e5928a277de admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.645825 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139123a8-1f71-4d1e-a5da-9e5928a277de admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.646099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139123a8-1f71-4d1e-a5da-9e5928a277de admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.646765 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139123a8-1f71-4d1e-a5da-9e5928a277de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:53.648699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139123a8-1f71-4d1e-a5da-9e5928a277de admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.669685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1328/2692] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:34:53 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:34:53.673826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30316-4c7d-4bf4-ab77-bfcb87a831ed admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:53.684165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30316-4c7d-4bf4-ab77-bfcb87a831ed admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:53.689287 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb14641-329d-4110-9266-b81240b38f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:53.689892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14641-329d-4110-9266-b81240b38f69 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.690176 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14641-329d-4110-9266-b81240b38f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.690454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14641-329d-4110-9266-b81240b38f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.691182 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb14641-329d-4110-9266-b81240b38f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:53.692782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb14641-329d-4110-9266-b81240b38f69 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.703312 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1365/2693] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:53.707158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139123a8-1f71-4d1e-a5da-9e5928a277de admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:53.716911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139123a8-1f71-4d1e-a5da-9e5928a277de admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:53.721465 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50445f3f-4eba-4ba2-ab85-a18fe4bd5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:53.722060 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445f3f-4eba-4ba2-ab85-a18fe4bd5d82 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.722340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445f3f-4eba-4ba2-ab85-a18fe4bd5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.722613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445f3f-4eba-4ba2-ab85-a18fe4bd5d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.723336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50445f3f-4eba-4ba2-ab85-a18fe4bd5d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:53.724941 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50445f3f-4eba-4ba2-ab85-a18fe4bd5d82 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.736688 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1329/2694] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:34:53.740703 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb14641-329d-4110-9266-b81240b38f69 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:53.751568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb14641-329d-4110-9266-b81240b38f69 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:53.756120 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266739d-0106-41ab-a2ef-f1e3b6578c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:53.756770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266739d-0106-41ab-a2ef-f1e3b6578c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.757051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266739d-0106-41ab-a2ef-f1e3b6578c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.757325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266739d-0106-41ab-a2ef-f1e3b6578c28 admin admin] PATH_INFO: `/v3/projects/0712d6de8a6843969076fc7de290a036/users/554553101a7446d89b9d83d0657fd15a/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.771512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266739d-0106-41ab-a2ef-f1e3b6578c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0712d6de8a6843969076fc7de290a036, user_id=554553101a7446d89b9d83d0657fd15a, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:53.774122 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266739d-0106-41ab-a2ef-f1e3b6578c28 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.786591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1366/2695] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:53 2022] PUT /identity/v3/projects/0712d6de8a6843969076fc7de290a036/users/554553101a7446d89b9d83d0657fd15a/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:53.798567 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeedc7-e6c6-47c0-b094-4462c8d4f752 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.798884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeedc7-e6c6-47c0-b094-4462c8d4f752 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.799184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeedc7-e6c6-47c0-b094-4462c8d4f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.826988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0ceeedc7-e6c6-47c0-b094-4462c8d4f752 None None] MFA Rules not processed for user `554553101a7446d89b9d83d0657fd15a`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:53.828224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0ceeedc7-e6c6-47c0-b094-4462c8d4f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:53.892534 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1330/2696] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:34:53.896964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266739d-0106-41ab-a2ef-f1e3b6578c28 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:53.953110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:53.957726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266739d-0106-41ab-a2ef-f1e3b6578c28 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:53.963605 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f812a9c-4e54-4486-85d0-5f91efe13c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:53.964402 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812a9c-4e54-4486-85d0-5f91efe13c14 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:53.964862 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812a9c-4e54-4486-85d0-5f91efe13c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:53.965193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812a9c-4e54-4486-85d0-5f91efe13c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:53.966045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f812a9c-4e54-4486-85d0-5f91efe13c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:53.967973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f812a9c-4e54-4486-85d0-5f91efe13c14 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:53.993733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1367/2697] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:34:53 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:34:53.998533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeedc7-e6c6-47c0-b094-4462c8d4f752 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.008853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeedc7-e6c6-47c0-b094-4462c8d4f752 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.066914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4b28-8580-409e-9508-f9b53dc05bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.067562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4b28-8580-409e-9508-f9b53dc05bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.067845 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4b28-8580-409e-9508-f9b53dc05bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.068122 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4b28-8580-409e-9508-f9b53dc05bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.068786 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4b28-8580-409e-9508-f9b53dc05bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.070687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4b28-8580-409e-9508-f9b53dc05bb4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.091681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1331/2698] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:34:53 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:34:54.095674 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f812a9c-4e54-4486-85d0-5f91efe13c14 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.110882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f812a9c-4e54-4486-85d0-5f91efe13c14 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.115505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2c78-dd40-46d5-a329-e31c69d02eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.116117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2c78-dd40-46d5-a329-e31c69d02eda admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.116397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2c78-dd40-46d5-a329-e31c69d02eda admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.116671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2c78-dd40-46d5-a329-e31c69d02eda admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.117363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb2c78-dd40-46d5-a329-e31c69d02eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.119230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb2c78-dd40-46d5-a329-e31c69d02eda admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.129797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1368/2699] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:54.133897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4b28-8580-409e-9508-f9b53dc05bb4 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.143680 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4b28-8580-409e-9508-f9b53dc05bb4 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.148268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455b38-8607-4ff6-b77f-054e4510b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.148857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455b38-8607-4ff6-b77f-054e4510b950 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.149139 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455b38-8607-4ff6-b77f-054e4510b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.149419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455b38-8607-4ff6-b77f-054e4510b950 admin admin] PATH_INFO: `/v3/projects/e72a993b30c74a51b5ee1753b50f7a47/users/82d830cc6a2a4a3c8e251534647a85d8/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.152468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:54.166036 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b455b38-8607-4ff6-b77f-054e4510b950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72a993b30c74a51b5ee1753b50f7a47, user_id=82d830cc6a2a4a3c8e251534647a85d8, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.168719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b455b38-8607-4ff6-b77f-054e4510b950 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.181752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1332/2700] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:54 2022] PUT /identity/v3/projects/e72a993b30c74a51b5ee1753b50f7a47/users/82d830cc6a2a4a3c8e251534647a85d8/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:54.185774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2c78-dd40-46d5-a329-e31c69d02eda admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.195951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2c78-dd40-46d5-a329-e31c69d02eda admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.251399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65125e-6eca-4141-a9e8-b9bdb2c39875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.252041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65125e-6eca-4141-a9e8-b9bdb2c39875 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.252327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65125e-6eca-4141-a9e8-b9bdb2c39875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.252610 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65125e-6eca-4141-a9e8-b9bdb2c39875 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.253327 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65125e-6eca-4141-a9e8-b9bdb2c39875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.254978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65125e-6eca-4141-a9e8-b9bdb2c39875 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.264624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1369/2701] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:54.268635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455b38-8607-4ff6-b77f-054e4510b950 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.279102 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455b38-8607-4ff6-b77f-054e4510b950 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.283593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.284243 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.284520 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.284790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] PATH_INFO: `/v3/projects/e72a993b30c74a51b5ee1753b50f7a47/users/82d830cc6a2a4a3c8e251534647a85d8/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.286713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72a993b30c74a51b5ee1753b50f7a47, user_id=82d830cc6a2a4a3c8e251534647a85d8, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.289331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.299803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1333/2702] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:54 2022] PUT /identity/v3/projects/e72a993b30c74a51b5ee1753b50f7a47/users/82d830cc6a2a4a3c8e251534647a85d8/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:34:54.310148 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482f4b0-1376-462b-8ff0-0e41fef35017 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.310446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482f4b0-1376-462b-8ff0-0e41fef35017 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.310742 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482f4b0-1376-462b-8ff0-0e41fef35017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.337807 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c482f4b0-1376-462b-8ff0-0e41fef35017 None None] MFA Rules not processed for user `82d830cc6a2a4a3c8e251534647a85d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:54.339063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c482f4b0-1376-462b-8ff0-0e41fef35017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:54.405859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1370/2703] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:54.417705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.420019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:54.475409 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65b2e-f13f-4951-ad5b-7e04b72443ad admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.479081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52be1b-da9d-45f1-bf5f-042921fba8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.479691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52be1b-da9d-45f1-bf5f-042921fba8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.479973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52be1b-da9d-45f1-bf5f-042921fba8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.480249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52be1b-da9d-45f1-bf5f-042921fba8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.489813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52be1b-da9d-45f1-bf5f-042921fba8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.491265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52be1b-da9d-45f1-bf5f-042921fba8b2 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.500879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1334/2704] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:54.800983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482f4b0-1376-462b-8ff0-0e41fef35017 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.809983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482f4b0-1376-462b-8ff0-0e41fef35017 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.814983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82d830cc6a2a4a3c8e251534647a85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72a993b30c74a51b5ee1753b50f7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.815603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.815886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.816163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.817126 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:34:54.817443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.819045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.830876 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1371/2705] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:34:54.835495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52be1b-da9d-45f1-bf5f-042921fba8b2 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.844779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52be1b-da9d-45f1-bf5f-042921fba8b2 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.849510 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f3a60-d234-4e70-b5ec-163728a7f64c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82d830cc6a2a4a3c8e251534647a85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72a993b30c74a51b5ee1753b50f7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.850123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3a60-d234-4e70-b5ec-163728a7f64c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.850411 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3a60-d234-4e70-b5ec-163728a7f64c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.850687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3a60-d234-4e70-b5ec-163728a7f64c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.851413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f3a60-d234-4e70-b5ec-163728a7f64c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.853299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f3a60-d234-4e70-b5ec-163728a7f64c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.879922 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1335/2706] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:34:54 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:34:54.884143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:54.894642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fff38-6d83-48a6-80d7-ecf0a2d9fef7 tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:54.926842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:54.951343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82d830cc6a2a4a3c8e251534647a85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72a993b30c74a51b5ee1753b50f7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:54.952463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:54.952745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:54.953021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:54.953713 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:34:54.954024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:54.955653 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:54.966734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1372/2707] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:34:55.002980 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f3a60-d234-4e70-b5ec-163728a7f64c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:55.012947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f3a60-d234-4e70-b5ec-163728a7f64c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:55.018099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82d830cc6a2a4a3c8e251534647a85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72a993b30c74a51b5ee1753b50f7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:55.018729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:55.019041 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:55.019318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] PATH_INFO: `/v3/projects/ebb4261c1f364f4394abc4f5ce8423ed` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:55.020481 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ebb4261c1f364f4394abc4f5ce8423ed)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:55.022367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:55.067805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb4261c1f364f4394abc4f5ce8423ed', 'request_id': 'req-1238a24b-20b7-45bc-b95f-c1cc01ec950c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.074228 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb4261c1f364f4394abc4f5ce8423ed', 'request_id': 'req-1238a24b-20b7-45bc-b95f-c1cc01ec950c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.081580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb4261c1f364f4394abc4f5ce8423ed', 'request_id': 'req-1238a24b-20b7-45bc-b95f-c1cc01ec950c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.091800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] The token cache is being invalidate because project ebb4261c1f364f4394abc4f5ce8423ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:34:55.092083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.092708 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-1238a24b-20b7-45bc-b95f-c1cc01ec950c tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.094179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1336/2708] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:34:55 2022] DELETE /identity/v3/projects/ebb4261c1f364f4394abc4f5ce8423ed => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:55.280317 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:55.282053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:55.347467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17480b-8080-40a8-9dca-adcb4d06bb0a tempest-VolumeQuotaClassesTest-1735451124 tempest-VolumeQuotaClassesTest-1735451124-project-admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:55.402001 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:55.402631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:55.402910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:55.403220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] PATH_INFO: `/v3/users/554553101a7446d89b9d83d0657fd15a` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:55.405019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=554553101a7446d89b9d83d0657fd15a)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:55.406957 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:55.450733 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554553101a7446d89b9d83d0657fd15a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.458209 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554553101a7446d89b9d83d0657fd15a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.465034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554553101a7446d89b9d83d0657fd15a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.465648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554553101a7446d89b9d83d0657fd15a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.477741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554553101a7446d89b9d83d0657fd15a'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:55.479141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:55.485307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1373/2709] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:34:55 2022] DELETE /identity/v3/users/554553101a7446d89b9d83d0657fd15a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:55.489857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9026cb-cdbb-4698-bc0c-c36ef5b9b087 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:55.490155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9026cb-cdbb-4698-bc0c-c36ef5b9b087 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:55.490443 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9026cb-cdbb-4698-bc0c-c36ef5b9b087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:55.509071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-8f9026cb-cdbb-4698-bc0c-c36ef5b9b087 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:55.510326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8f9026cb-cdbb-4698-bc0c-c36ef5b9b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:55.540644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:55.570370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1337/2710] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:55.580591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:55.581978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:55.638774 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d029f-2e09-4819-a244-80b58dcdf48b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:55.642507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5e6fb-4f64-41e3-a36d-f8fbc301d4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:55.643155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e6fb-4f64-41e3-a36d-f8fbc301d4db service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:55.643438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e6fb-4f64-41e3-a36d-f8fbc301d4db service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:55.643715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e6fb-4f64-41e3-a36d-f8fbc301d4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:55.652654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5e6fb-4f64-41e3-a36d-f8fbc301d4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:55.654094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5e6fb-4f64-41e3-a36d-f8fbc301d4db service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:55.664025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1374/2711] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:55.926495 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9026cb-cdbb-4698-bc0c-c36ef5b9b087 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:55.928001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8f9026cb-cdbb-4698-bc0c-c36ef5b9b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:55.939762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9026cb-cdbb-4698-bc0c-c36ef5b9b087 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:55.944308 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:55.944962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:55.945355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:55.945631 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] PATH_INFO: `/v3/projects/0712d6de8a6843969076fc7de290a036` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:55.946794 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0712d6de8a6843969076fc7de290a036)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:55.948739 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:55.995444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0712d6de8a6843969076fc7de290a036', 'request_id': 'req-e3bfc250-29a9-4822-86db-7a8e485e0d90'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.001909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0712d6de8a6843969076fc7de290a036', 'request_id': 'req-e3bfc250-29a9-4822-86db-7a8e485e0d90'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.009284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0712d6de8a6843969076fc7de290a036', 'request_id': 'req-e3bfc250-29a9-4822-86db-7a8e485e0d90'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.020734 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] The token cache is being invalidate because project 0712d6de8a6843969076fc7de290a036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:34:56.020938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.021487 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.023167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1338/2712] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:34:55 2022] DELETE /identity/v3/projects/0712d6de8a6843969076fc7de290a036 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:56.027689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5e6fb-4f64-41e3-a36d-f8fbc301d4db service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:56.038059 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5e6fb-4f64-41e3-a36d-f8fbc301d4db service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:56.095084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:56.095648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.095930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.096207 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] PATH_INFO: `/v3/users/82d830cc6a2a4a3c8e251534647a85d8` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.097365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d830cc6a2a4a3c8e251534647a85d8)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:56.099309 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:56.146278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d830cc6a2a4a3c8e251534647a85d8'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.153274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d830cc6a2a4a3c8e251534647a85d8'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.160588 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d830cc6a2a4a3c8e251534647a85d8'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.161214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d830cc6a2a4a3c8e251534647a85d8'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.173012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-88091c27-8638-4f2d-b32d-cd993b58392b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d830cc6a2a4a3c8e251534647a85d8'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.178805 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1375/2713] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:34:56 2022] DELETE /identity/v3/users/82d830cc6a2a4a3c8e251534647a85d8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:56.442747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:56.444258 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:56.458754 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc250-29a9-4822-86db-7a8e485e0d90 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:56.517184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:56.517920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.518103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.518376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] PATH_INFO: `/v3/projects/e72a993b30c74a51b5ee1753b50f7a47` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.519553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72a993b30c74a51b5ee1753b50f7a47)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:56.521486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:56.565285 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72a993b30c74a51b5ee1753b50f7a47', 'request_id': 'req-962a1aad-953c-4394-8a0a-b46223e23cf0'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.571156 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72a993b30c74a51b5ee1753b50f7a47', 'request_id': 'req-962a1aad-953c-4394-8a0a-b46223e23cf0'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.578745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72a993b30c74a51b5ee1753b50f7a47', 'request_id': 'req-962a1aad-953c-4394-8a0a-b46223e23cf0'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.579994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:56.591292 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] The token cache is being invalidate because project e72a993b30c74a51b5ee1753b50f7a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:34:56.591737 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.592575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-962a1aad-953c-4394-8a0a-b46223e23cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:56.594151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1339/2714] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:34:56 2022] DELETE /identity/v3/projects/e72a993b30c74a51b5ee1753b50f7a47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:34:56.598990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c4b4d-9ef2-471a-ae31-0f7a6a2ba31c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.599283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c4b4d-9ef2-471a-ae31-0f7a6a2ba31c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.599564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c4b4d-9ef2-471a-ae31-0f7a6a2ba31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.619065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-c39c4b4d-9ef2-471a-ae31-0f7a6a2ba31c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:56.620199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-c39c4b4d-9ef2-471a-ae31-0f7a6a2ba31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:56.633101 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:56.679513 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1376/2715] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:56.688085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99d82a-cf8b-4241-ad5e-d204d84dc7f1 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.688374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99d82a-cf8b-4241-ad5e-d204d84dc7f1 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.688649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99d82a-cf8b-4241-ad5e-d204d84dc7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.708059 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-eb99d82a-cf8b-4241-ad5e-d204d84dc7f1 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:56.709233 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-eb99d82a-cf8b-4241-ad5e-d204d84dc7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:56.716937 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1340/2716] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:56.721016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c4b4d-9ef2-471a-ae31-0f7a6a2ba31c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:56.730572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c4b4d-9ef2-471a-ae31-0f7a6a2ba31c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:56.735813 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:56.736416 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.736698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.736971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.737664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:34:56.737970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:56.739599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:56.751839 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1377/2717] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 08:34:56.756002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99d82a-cf8b-4241-ad5e-d204d84dc7f1 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:56.764902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99d82a-cf8b-4241-ad5e-d204d84dc7f1 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:56.769514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a4316-f976-47de-8457-e28587d32177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:56.770109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a4316-f976-47de-8457-e28587d32177 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.770388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a4316-f976-47de-8457-e28587d32177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.770661 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a4316-f976-47de-8457-e28587d32177 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.771359 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a4316-f976-47de-8457-e28587d32177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:56.773250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a4316-f976-47de-8457-e28587d32177 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:56.799857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1341/2718] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:34:56 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:34:56.803801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:56.814343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a180d0-4cb7-4110-807e-f719ec1b7b96 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:56.874306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00282b03-72f7-4d1e-af5f-8d102b94dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:56.874856 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00282b03-72f7-4d1e-af5f-8d102b94dafc admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.875169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00282b03-72f7-4d1e-af5f-8d102b94dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.875446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00282b03-72f7-4d1e-af5f-8d102b94dafc admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.876116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00282b03-72f7-4d1e-af5f-8d102b94dafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:56.878043 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00282b03-72f7-4d1e-af5f-8d102b94dafc admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:56.900066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1378/2719] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:34:56 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:34:56.904187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a4316-f976-47de-8457-e28587d32177 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:56.914749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a4316-f976-47de-8457-e28587d32177 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:56.919384 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afaf173-d1d3-46e5-87b4-a8aea3a27c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:56.920033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaf173-d1d3-46e5-87b4-a8aea3a27c4b admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.920318 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaf173-d1d3-46e5-87b4-a8aea3a27c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.920594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaf173-d1d3-46e5-87b4-a8aea3a27c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.921289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afaf173-d1d3-46e5-87b4-a8aea3a27c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:56.922868 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afaf173-d1d3-46e5-87b4-a8aea3a27c4b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:56.932612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1342/2720] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:56.936399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00282b03-72f7-4d1e-af5f-8d102b94dafc admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:56.946091 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00282b03-72f7-4d1e-af5f-8d102b94dafc admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:56.950782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a7f7-2a74-44c0-b656-ed9ec142aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:56.951920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a7f7-2a74-44c0-b656-ed9ec142aa21 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.952201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a7f7-2a74-44c0-b656-ed9ec142aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.952472 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a7f7-2a74-44c0-b656-ed9ec142aa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.953157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a7f7-2a74-44c0-b656-ed9ec142aa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:56.954745 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a7f7-2a74-44c0-b656-ed9ec142aa21 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:56.965026 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1379/2721] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:56.969477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afaf173-d1d3-46e5-87b4-a8aea3a27c4b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:56.979180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afaf173-d1d3-46e5-87b4-a8aea3a27c4b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:56.983757 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897a215-4956-4c3a-884b-2225d0c3ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:56.984399 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897a215-4956-4c3a-884b-2225d0c3ca62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:56.984683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897a215-4956-4c3a-884b-2225d0c3ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:56.984964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897a215-4956-4c3a-884b-2225d0c3ca62 admin admin] PATH_INFO: `/v3/projects/40aa5142ace9459281f9fbb8fdadfea2/users/53598dabe2aa422d96f6d05fe825f535/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:56.999249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897a215-4956-4c3a-884b-2225d0c3ca62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40aa5142ace9459281f9fbb8fdadfea2, user_id=53598dabe2aa422d96f6d05fe825f535, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.001858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897a215-4956-4c3a-884b-2225d0c3ca62 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.014974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1343/2722] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:56 2022] PUT /identity/v3/projects/40aa5142ace9459281f9fbb8fdadfea2/users/53598dabe2aa422d96f6d05fe825f535/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:57.026057 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed056e7-3347-4aac-bbb0-bcb258f666cc None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.026346 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed056e7-3347-4aac-bbb0-bcb258f666cc None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.026647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed056e7-3347-4aac-bbb0-bcb258f666cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.053747 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-bed056e7-3347-4aac-bbb0-bcb258f666cc None None] MFA Rules not processed for user `53598dabe2aa422d96f6d05fe825f535`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:57.054944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bed056e7-3347-4aac-bbb0-bcb258f666cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:57.116850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1380/2723] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:57.121482 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897a215-4956-4c3a-884b-2225d0c3ca62 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:57.181351 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897a215-4956-4c3a-884b-2225d0c3ca62 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:57.186367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5eb8c-aae0-4e06-982b-6667b003f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:57.186994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5eb8c-aae0-4e06-982b-6667b003f103 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.187276 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5eb8c-aae0-4e06-982b-6667b003f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.187549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5eb8c-aae0-4e06-982b-6667b003f103 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.188202 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5eb8c-aae0-4e06-982b-6667b003f103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.190072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5eb8c-aae0-4e06-982b-6667b003f103 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.215540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1344/2724] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:34:57 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:34:57.219559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed056e7-3347-4aac-bbb0-bcb258f666cc None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:57.230064 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed056e7-3347-4aac-bbb0-bcb258f666cc None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:57.241616 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:57.288521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b1f0-a445-4985-b457-0f393026992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:57.289140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b1f0-a445-4985-b457-0f393026992e admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.289420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b1f0-a445-4985-b457-0f393026992e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.289692 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b1f0-a445-4985-b457-0f393026992e admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.290361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167b1f0-a445-4985-b457-0f393026992e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.292333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167b1f0-a445-4985-b457-0f393026992e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.312818 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1381/2725] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:34:57 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:34:57.316885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5eb8c-aae0-4e06-982b-6667b003f103 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:57.327554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5eb8c-aae0-4e06-982b-6667b003f103 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:57.332427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333dacb-1a5c-4226-9805-80c9796313b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:57.333084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333dacb-1a5c-4226-9805-80c9796313b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.333370 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333dacb-1a5c-4226-9805-80c9796313b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.333639 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333dacb-1a5c-4226-9805-80c9796313b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.334388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333dacb-1a5c-4226-9805-80c9796313b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.336053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333dacb-1a5c-4226-9805-80c9796313b4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.346514 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1345/2726] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:57.350457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b1f0-a445-4985-b457-0f393026992e admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:57.360196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b1f0-a445-4985-b457-0f393026992e admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:57.364780 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e640-e45f-4728-a8d7-9e259f6f9c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:57.365565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e640-e45f-4728-a8d7-9e259f6f9c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.365848 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e640-e45f-4728-a8d7-9e259f6f9c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.366125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e640-e45f-4728-a8d7-9e259f6f9c04 admin admin] PATH_INFO: `/v3/projects/b3be96fbbbb0464cb1c0c4b4b2178dfd/users/183f41e852da49d3a6bf316d4f68d92d/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.381542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3e640-e45f-4728-a8d7-9e259f6f9c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3be96fbbbb0464cb1c0c4b4b2178dfd, user_id=183f41e852da49d3a6bf316d4f68d92d, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.384302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3e640-e45f-4728-a8d7-9e259f6f9c04 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.397375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1382/2727] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:57 2022] PUT /identity/v3/projects/b3be96fbbbb0464cb1c0c4b4b2178dfd/users/183f41e852da49d3a6bf316d4f68d92d/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:57.401235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333dacb-1a5c-4226-9805-80c9796313b4 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:57.410861 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333dacb-1a5c-4226-9805-80c9796313b4 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:57.466032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe46fe3-2602-4986-aba8-60898a16470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:57.466574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe46fe3-2602-4986-aba8-60898a16470d admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.466865 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe46fe3-2602-4986-aba8-60898a16470d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.467177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe46fe3-2602-4986-aba8-60898a16470d admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.467874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe46fe3-2602-4986-aba8-60898a16470d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.469459 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe46fe3-2602-4986-aba8-60898a16470d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.470706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:57.481081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1346/2728] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:34:57.485339 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e640-e45f-4728-a8d7-9e259f6f9c04 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:57.495855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e640-e45f-4728-a8d7-9e259f6f9c04 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:57.501075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:57.501731 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.502017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.502295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] PATH_INFO: `/v3/projects/b3be96fbbbb0464cb1c0c4b4b2178dfd/users/183f41e852da49d3a6bf316d4f68d92d/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.504289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3be96fbbbb0464cb1c0c4b4b2178dfd, user_id=183f41e852da49d3a6bf316d4f68d92d, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.506897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.516991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1383/2729] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:57 2022] PUT /identity/v3/projects/b3be96fbbbb0464cb1c0c4b4b2178dfd/users/183f41e852da49d3a6bf316d4f68d92d/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:57.526918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222fd5d-eb48-4d75-a1ed-03c57d51e413 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.527240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222fd5d-eb48-4d75-a1ed-03c57d51e413 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.527523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222fd5d-eb48-4d75-a1ed-03c57d51e413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.554612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0222fd5d-eb48-4d75-a1ed-03c57d51e413 None None] MFA Rules not processed for user `183f41e852da49d3a6bf316d4f68d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:57.555879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0222fd5d-eb48-4d75-a1ed-03c57d51e413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:57.622673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1347/2730] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:34:57.634640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:57.636343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:57.692704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437756bd-d14e-47ec-a548-afa5e3c3b91d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:57.696372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598bfc4-b9d7-4853-886a-46c6f3a5289a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:57.696977 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598bfc4-b9d7-4853-886a-46c6f3a5289a service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.697280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598bfc4-b9d7-4853-886a-46c6f3a5289a service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.697552 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598bfc4-b9d7-4853-886a-46c6f3a5289a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.706372 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598bfc4-b9d7-4853-886a-46c6f3a5289a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.707991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598bfc4-b9d7-4853-886a-46c6f3a5289a service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.717336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1384/2731] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:57.848575 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222fd5d-eb48-4d75-a1ed-03c57d51e413 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:57.909310 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222fd5d-eb48-4d75-a1ed-03c57d51e413 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:57.913729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:57.914358 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:57.914638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:57.914911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] PATH_INFO: `/v3/users/53598dabe2aa422d96f6d05fe825f535` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:57.916101 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53598dabe2aa422d96f6d05fe825f535)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:57.918002 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:57.962123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53598dabe2aa422d96f6d05fe825f535'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:57.969474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53598dabe2aa422d96f6d05fe825f535'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:57.970066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53598dabe2aa422d96f6d05fe825f535'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:57.981571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53598dabe2aa422d96f6d05fe825f535'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:57.982191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53598dabe2aa422d96f6d05fe825f535'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:57.991662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:57.996656 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1348/2732] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:34:57 2022] DELETE /identity/v3/users/53598dabe2aa422d96f6d05fe825f535 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:58.001461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdd88-858e-4ecb-be65-718ae0faec91 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:58.001748 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdd88-858e-4ecb-be65-718ae0faec91 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:58.002093 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdd88-858e-4ecb-be65-718ae0faec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:58.020517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3f3bdd88-858e-4ecb-be65-718ae0faec91 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:58.021718 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3f3bdd88-858e-4ecb-be65-718ae0faec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:58.078640 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1385/2733] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:34:58.088171 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:58.089604 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:58.148889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dbb43-2533-458a-b2a4-57c332bfc159 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:58.152740 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66736-2ab0-4e5a-a86a-a5dfea4fa949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:58.153356 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66736-2ab0-4e5a-a86a-a5dfea4fa949 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:58.153640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66736-2ab0-4e5a-a86a-a5dfea4fa949 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:58.153914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66736-2ab0-4e5a-a86a-a5dfea4fa949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:58.163395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce66736-2ab0-4e5a-a86a-a5dfea4fa949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:58.164816 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce66736-2ab0-4e5a-a86a-a5dfea4fa949 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:58.174626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1349/2734] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:34:58.438356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdd88-858e-4ecb-be65-718ae0faec91 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:58.439849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3f3bdd88-858e-4ecb-be65-718ae0faec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:58.452966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdd88-858e-4ecb-be65-718ae0faec91 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:58.458081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:58.458811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:58.459127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:58.459463 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] PATH_INFO: `/v3/projects/40aa5142ace9459281f9fbb8fdadfea2` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:58.460659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40aa5142ace9459281f9fbb8fdadfea2)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:58.462579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:58.470029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:58.511520 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40aa5142ace9459281f9fbb8fdadfea2', 'request_id': 'req-60eadb33-6f54-4740-9d8e-a627de691d35'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.519196 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40aa5142ace9459281f9fbb8fdadfea2', 'request_id': 'req-60eadb33-6f54-4740-9d8e-a627de691d35'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.525238 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40aa5142ace9459281f9fbb8fdadfea2', 'request_id': 'req-60eadb33-6f54-4740-9d8e-a627de691d35'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.536665 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] The token cache is being invalidate because project 40aa5142ace9459281f9fbb8fdadfea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:34:58.536960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.537600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.539225 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1386/2735] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:34:58 2022] DELETE /identity/v3/projects/40aa5142ace9459281f9fbb8fdadfea2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:58.543189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66736-2ab0-4e5a-a86a-a5dfea4fa949 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:58.552572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66736-2ab0-4e5a-a86a-a5dfea4fa949 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:58.607355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:58.607985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:58.608264 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:58.608562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] PATH_INFO: `/v3/users/183f41e852da49d3a6bf316d4f68d92d` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:58.609713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=183f41e852da49d3a6bf316d4f68d92d)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:58.612071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:58.657635 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '183f41e852da49d3a6bf316d4f68d92d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.664451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '183f41e852da49d3a6bf316d4f68d92d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.665107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '183f41e852da49d3a6bf316d4f68d92d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.676747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '183f41e852da49d3a6bf316d4f68d92d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.677376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-4736de44-caac-4e9d-a4e0-3ebc8bec7d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '183f41e852da49d3a6bf316d4f68d92d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:58.690157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1350/2736] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:34:58 2022] DELETE /identity/v3/users/183f41e852da49d3a6bf316d4f68d92d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:58.961467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:58.962919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:58.976564 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eadb33-6f54-4740-9d8e-a627de691d35 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.033070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.033637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.033916 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.034189 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] PATH_INFO: `/v3/projects/b3be96fbbbb0464cb1c0c4b4b2178dfd` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.035364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3be96fbbbb0464cb1c0c4b4b2178dfd)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.037257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.081561 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3be96fbbbb0464cb1c0c4b4b2178dfd', 'request_id': 'req-861f2e2c-ef72-491a-a410-4f60e07d962c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:59.088083 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3be96fbbbb0464cb1c0c4b4b2178dfd', 'request_id': 'req-861f2e2c-ef72-491a-a410-4f60e07d962c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:59.093765 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3be96fbbbb0464cb1c0c4b4b2178dfd', 'request_id': 'req-861f2e2c-ef72-491a-a410-4f60e07d962c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:59.104569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] The token cache is being invalidate because project b3be96fbbbb0464cb1c0c4b4b2178dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:34:59.104858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:59.105489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-861f2e2c-ef72-491a-a410-4f60e07d962c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:34:59.107010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1387/2737] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:34:58 2022] DELETE /identity/v3/projects/b3be96fbbbb0464cb1c0c4b4b2178dfd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:59.112353 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b365e-4bd8-4d8b-bf6c-62cfedc2eccd None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.112822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b365e-4bd8-4d8b-bf6c-62cfedc2eccd None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.112921 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b365e-4bd8-4d8b-bf6c-62cfedc2eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.132424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ed7b365e-4bd8-4d8b-bf6c-62cfedc2eccd None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:59.133612 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ed7b365e-4bd8-4d8b-bf6c-62cfedc2eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:59.149813 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:59.193915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1351/2738] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:59.202804 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df986a2-4dc8-4d00-a146-2122861ad0c8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.203116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df986a2-4dc8-4d00-a146-2122861ad0c8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.203389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df986a2-4dc8-4d00-a146-2122861ad0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.222380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-1df986a2-4dc8-4d00-a146-2122861ad0c8 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:59.223615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1df986a2-4dc8-4d00-a146-2122861ad0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:59.231281 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1388/2739] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:59.235903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b365e-4bd8-4d8b-bf6c-62cfedc2eccd None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.245677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b365e-4bd8-4d8b-bf6c-62cfedc2eccd None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.250886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.251521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.251802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.252076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.252764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:34:59.253066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.254645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.265955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1352/2740] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:34:59.270002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df986a2-4dc8-4d00-a146-2122861ad0c8 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.279110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df986a2-4dc8-4d00-a146-2122861ad0c8 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.283806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0a53-97bc-45bc-9544-44e0e2785c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.284349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0a53-97bc-45bc-9544-44e0e2785c90 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.284626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0a53-97bc-45bc-9544-44e0e2785c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.284897 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0a53-97bc-45bc-9544-44e0e2785c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.285560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df0a53-97bc-45bc-9544-44e0e2785c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.287473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df0a53-97bc-45bc-9544-44e0e2785c90 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.303403 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:59.316766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1389/2741] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:34:59 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:34:59.320546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.330850 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd57f-91ea-4aa2-a585-00150809b26f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.386313 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6984-0845-4745-954a-1589bed0e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.386954 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6984-0845-4745-954a-1589bed0e075 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.387256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6984-0845-4745-954a-1589bed0e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.387535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6984-0845-4745-954a-1589bed0e075 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.388195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f6984-0845-4745-954a-1589bed0e075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.390093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f6984-0845-4745-954a-1589bed0e075 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.409820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1353/2742] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:34:59 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:34:59.413896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0a53-97bc-45bc-9544-44e0e2785c90 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.424685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0a53-97bc-45bc-9544-44e0e2785c90 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.429211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1398c6-6020-4e85-b05a-67b15a4997b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.429808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1398c6-6020-4e85-b05a-67b15a4997b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.430086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1398c6-6020-4e85-b05a-67b15a4997b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.430357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1398c6-6020-4e85-b05a-67b15a4997b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.431104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1398c6-6020-4e85-b05a-67b15a4997b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.432679 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1398c6-6020-4e85-b05a-67b15a4997b5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.442384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1390/2743] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:59.446025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6984-0845-4745-954a-1589bed0e075 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.456256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6984-0845-4745-954a-1589bed0e075 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.460814 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ed9b-3c63-4154-8f8c-1456051a5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.461418 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ed9b-3c63-4154-8f8c-1456051a5aab admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.461699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ed9b-3c63-4154-8f8c-1456051a5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.461973 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ed9b-3c63-4154-8f8c-1456051a5aab admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.462664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ed9b-3c63-4154-8f8c-1456051a5aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.464273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ed9b-3c63-4154-8f8c-1456051a5aab admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.474986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1354/2744] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:59.478838 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1398c6-6020-4e85-b05a-67b15a4997b5 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.489100 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1398c6-6020-4e85-b05a-67b15a4997b5 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.493944 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a0e1-2ad0-4119-9be8-1be9b9540214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.494590 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a0e1-2ad0-4119-9be8-1be9b9540214 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.494868 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a0e1-2ad0-4119-9be8-1be9b9540214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.495169 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a0e1-2ad0-4119-9be8-1be9b9540214 admin admin] PATH_INFO: `/v3/projects/ceb46e5ce1c64badb1b53db6bd2e2ea9/users/8e819bb044774a6489bd39e4ccbc232c/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.509223 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558a0e1-2ad0-4119-9be8-1be9b9540214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb46e5ce1c64badb1b53db6bd2e2ea9, user_id=8e819bb044774a6489bd39e4ccbc232c, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.511870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558a0e1-2ad0-4119-9be8-1be9b9540214 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.524509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1391/2745] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:59 2022] PUT /identity/v3/projects/ceb46e5ce1c64badb1b53db6bd2e2ea9/users/8e819bb044774a6489bd39e4ccbc232c/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:34:59.535642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526f00-108b-439b-847c-57b162febc8b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.535877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526f00-108b-439b-847c-57b162febc8b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.536197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526f00-108b-439b-847c-57b162febc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.563650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-db526f00-108b-439b-847c-57b162febc8b None None] MFA Rules not processed for user `8e819bb044774a6489bd39e4ccbc232c`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:34:59.564888 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-db526f00-108b-439b-847c-57b162febc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:34:59.628125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1355/2746] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:34:59.632550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a0e1-2ad0-4119-9be8-1be9b9540214 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.693817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a0e1-2ad0-4119-9be8-1be9b9540214 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.698417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed382d7-58b8-413f-9efe-01c50c571496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.699051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed382d7-58b8-413f-9efe-01c50c571496 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.699331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed382d7-58b8-413f-9efe-01c50c571496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.699603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed382d7-58b8-413f-9efe-01c50c571496 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.700250 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed382d7-58b8-413f-9efe-01c50c571496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.702642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed382d7-58b8-413f-9efe-01c50c571496 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.729031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1392/2747] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:34:59 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:34:59.733107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526f00-108b-439b-847c-57b162febc8b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.743998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526f00-108b-439b-847c-57b162febc8b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.755936 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:34:59.801745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45bf5f-5d9d-4968-ac3a-2b4e706f2022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.802309 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45bf5f-5d9d-4968-ac3a-2b4e706f2022 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.802594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45bf5f-5d9d-4968-ac3a-2b4e706f2022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.803019 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45bf5f-5d9d-4968-ac3a-2b4e706f2022 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.803887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45bf5f-5d9d-4968-ac3a-2b4e706f2022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.805967 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45bf5f-5d9d-4968-ac3a-2b4e706f2022 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.827543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1356/2748] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:34:59 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:34:59.831509 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed382d7-58b8-413f-9efe-01c50c571496 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.842881 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed382d7-58b8-413f-9efe-01c50c571496 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.847592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0bb98-a000-495f-95bc-89678a151333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.848204 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bb98-a000-495f-95bc-89678a151333 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.848480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bb98-a000-495f-95bc-89678a151333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.848750 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bb98-a000-495f-95bc-89678a151333 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.849753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0bb98-a000-495f-95bc-89678a151333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.851081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0bb98-a000-495f-95bc-89678a151333 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.862079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1393/2749] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:34:59.866197 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45bf5f-5d9d-4968-ac3a-2b4e706f2022 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.876426 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45bf5f-5d9d-4968-ac3a-2b4e706f2022 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.880986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b54b6-1bc1-47d0-ae77-8f4f67e11bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.881633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b54b6-1bc1-47d0-ae77-8f4f67e11bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.881908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b54b6-1bc1-47d0-ae77-8f4f67e11bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.882179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b54b6-1bc1-47d0-ae77-8f4f67e11bb5 admin admin] PATH_INFO: `/v3/projects/5b3a45b4ac954af497482e64a541d8a2/users/26b84092aa104a678b634746a685fcfa/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.897295 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b54b6-1bc1-47d0-ae77-8f4f67e11bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3a45b4ac954af497482e64a541d8a2, user_id=26b84092aa104a678b634746a685fcfa, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.900015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b54b6-1bc1-47d0-ae77-8f4f67e11bb5 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.913151 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1357/2750] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:59 2022] PUT /identity/v3/projects/5b3a45b4ac954af497482e64a541d8a2/users/26b84092aa104a678b634746a685fcfa/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:34:59.917090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0bb98-a000-495f-95bc-89678a151333 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:34:59.927019 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0bb98-a000-495f-95bc-89678a151333 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:34:59.981904 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf2bec-a035-4540-8755-f06aca9ad219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:34:59.982541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2bec-a035-4540-8755-f06aca9ad219 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:34:59.982824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2bec-a035-4540-8755-f06aca9ad219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:34:59.983161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2bec-a035-4540-8755-f06aca9ad219 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:34:59.983853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf2bec-a035-4540-8755-f06aca9ad219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:34:59.985443 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf2bec-a035-4540-8755-f06aca9ad219 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:34:59.995545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1394/2751] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:34:59.999598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b54b6-1bc1-47d0-ae77-8f4f67e11bb5 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:00.010193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b54b6-1bc1-47d0-ae77-8f4f67e11bb5 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:00.015226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:00.015875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:00.016157 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:00.016509 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] PATH_INFO: `/v3/projects/5b3a45b4ac954af497482e64a541d8a2/users/26b84092aa104a678b634746a685fcfa/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:00.018614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3a45b4ac954af497482e64a541d8a2, user_id=26b84092aa104a678b634746a685fcfa, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:00.021231 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:00.032046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1358/2752] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:34:59 2022] PUT /identity/v3/projects/5b3a45b4ac954af497482e64a541d8a2/users/26b84092aa104a678b634746a685fcfa/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:00.042073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a659f-cbc3-4c84-b528-6c70d1c56f24 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:00.042384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a659f-cbc3-4c84-b528-6c70d1c56f24 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:00.042695 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a659f-cbc3-4c84-b528-6c70d1c56f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:00.070420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-838a659f-cbc3-4c84-b528-6c70d1c56f24 None None] MFA Rules not processed for user `26b84092aa104a678b634746a685fcfa`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:00.071566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-838a659f-cbc3-4c84-b528-6c70d1c56f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:00.089983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:00.141291 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1395/2753] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:35:00.152219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:00.154093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:00.211871 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683252-4dc4-4306-adc0-2d5257afc925 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:00.215458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2e65-0846-4da4-bacb-78a720b6efcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:00.216056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2e65-0846-4da4-bacb-78a720b6efcc service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:00.216333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2e65-0846-4da4-bacb-78a720b6efcc service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:00.216633 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d2e65-0846-4da4-bacb-78a720b6efcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:00.226337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d2e65-0846-4da4-bacb-78a720b6efcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:00.227801 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d2e65-0846-4da4-bacb-78a720b6efcc service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:00.237345 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1359/2754] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:35:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:35:00.319714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a659f-cbc3-4c84-b528-6c70d1c56f24 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:00.329826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a659f-cbc3-4c84-b528-6c70d1c56f24 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:00.333349 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d79bdc-9505-44a9-a95e-90e010841dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:00.334039 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d79bdc-9505-44a9-a95e-90e010841dbc service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:00.334323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d79bdc-9505-44a9-a95e-90e010841dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:00.334601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d79bdc-9505-44a9-a95e-90e010841dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:00.390082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d79bdc-9505-44a9-a95e-90e010841dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:00.391548 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d79bdc-9505-44a9-a95e-90e010841dbc service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:00.400358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1396/2755] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:35:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:35:05.064554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2e65-0846-4da4-bacb-78a720b6efcc service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:05.124948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d2e65-0846-4da4-bacb-78a720b6efcc service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:05.129596 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:05.130224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:05.130502 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:05.130775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] PATH_INFO: `/v3/users/8e819bb044774a6489bd39e4ccbc232c` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:05.132297 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e819bb044774a6489bd39e4ccbc232c)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:05.134198 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:05.147301 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:05.179638 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e819bb044774a6489bd39e4ccbc232c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.187392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e819bb044774a6489bd39e4ccbc232c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.188065 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e819bb044774a6489bd39e4ccbc232c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.200283 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e819bb044774a6489bd39e4ccbc232c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.200913 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e819bb044774a6489bd39e4ccbc232c'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.213424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1360/2756] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:35:05 2022] DELETE /identity/v3/users/8e819bb044774a6489bd39e4ccbc232c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:05.220137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a9a9-bbb2-46c1-8c5e-618c5633f004 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:05.220137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a9a9-bbb2-46c1-8c5e-618c5633f004 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:05.220137 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a9a9-bbb2-46c1-8c5e-618c5633f004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:05.237930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-4df1a9a9-bbb2-46c1-8c5e-618c5633f004 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:05.239172 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4df1a9a9-bbb2-46c1-8c5e-618c5633f004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:05.303855 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1397/2757] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:35:05.313381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:05.314759 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:05.370915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d34c1-8735-4cf0-9315-82a73012bb48 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:05.374614 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c0868-b671-437f-8016-d54fd20a93fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:05.375311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0868-b671-437f-8016-d54fd20a93fe service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:05.375546 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0868-b671-437f-8016-d54fd20a93fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:05.375820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c0868-b671-437f-8016-d54fd20a93fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:05.384755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c0868-b671-437f-8016-d54fd20a93fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:05.386179 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c0868-b671-437f-8016-d54fd20a93fe service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:05.395477 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1361/2758] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:35:05.666367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1a9a9-bbb2-46c1-8c5e-618c5633f004 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:05.667821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-4df1a9a9-bbb2-46c1-8c5e-618c5633f004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:05.682543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1a9a9-bbb2-46c1-8c5e-618c5633f004 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:05.687920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:05.688920 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:05.689231 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:05.689537 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] PATH_INFO: `/v3/projects/ceb46e5ce1c64badb1b53db6bd2e2ea9` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:05.690681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb46e5ce1c64badb1b53db6bd2e2ea9)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:05.692593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:05.739331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb46e5ce1c64badb1b53db6bd2e2ea9', 'request_id': 'req-398e9011-78c3-4f6e-9b76-1800122154be'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.740950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:05.747357 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb46e5ce1c64badb1b53db6bd2e2ea9', 'request_id': 'req-398e9011-78c3-4f6e-9b76-1800122154be'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.753062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb46e5ce1c64badb1b53db6bd2e2ea9', 'request_id': 'req-398e9011-78c3-4f6e-9b76-1800122154be'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.763702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] The token cache is being invalidate because project ceb46e5ce1c64badb1b53db6bd2e2ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:35:05.763986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.764606 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.766582 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1398/2759] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:35:05 2022] DELETE /identity/v3/projects/ceb46e5ce1c64badb1b53db6bd2e2ea9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:05.770573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c0868-b671-437f-8016-d54fd20a93fe service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:05.780113 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c0868-b671-437f-8016-d54fd20a93fe service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:05.835958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:05.836598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:05.836881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:05.837159 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] PATH_INFO: `/v3/users/26b84092aa104a678b634746a685fcfa` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:05.838386 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b84092aa104a678b634746a685fcfa)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:05.840431 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:05.878736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:05.888003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b84092aa104a678b634746a685fcfa'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.894714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b84092aa104a678b634746a685fcfa'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.895415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b84092aa104a678b634746a685fcfa'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.906990 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b84092aa104a678b634746a685fcfa'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.907637 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-f2a58e6f-93aa-4cad-8ab5-f322ef1825a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b84092aa104a678b634746a685fcfa'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:05.919466 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1362/2760] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:35:05 2022] DELETE /identity/v3/users/26b84092aa104a678b634746a685fcfa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:06.183533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:06.185021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:06.198469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e9011-78c3-4f6e-9b76-1800122154be admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:06.254386 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:06.255048 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.255328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.255603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] PATH_INFO: `/v3/projects/5b3a45b4ac954af497482e64a541d8a2` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.256771 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3a45b4ac954af497482e64a541d8a2)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:06.258670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:06.303903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3a45b4ac954af497482e64a541d8a2', 'request_id': 'req-caf8ddaa-465c-4f09-ad8d-1b21632c7487'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:06.311179 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3a45b4ac954af497482e64a541d8a2', 'request_id': 'req-caf8ddaa-465c-4f09-ad8d-1b21632c7487'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:06.316676 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3a45b4ac954af497482e64a541d8a2', 'request_id': 'req-caf8ddaa-465c-4f09-ad8d-1b21632c7487'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:06.327883 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] The token cache is being invalidate because project 5b3a45b4ac954af497482e64a541d8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:35:06.328173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:06.328811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-caf8ddaa-465c-4f09-ad8d-1b21632c7487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:06.330355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1399/2761] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:35:06 2022] DELETE /identity/v3/projects/5b3a45b4ac954af497482e64a541d8a2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:06.335341 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411e7a-1b8b-47f6-b5e8-23983e7cca92 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.335818 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411e7a-1b8b-47f6-b5e8-23983e7cca92 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.335909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411e7a-1b8b-47f6-b5e8-23983e7cca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.355458 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-93411e7a-1b8b-47f6-b5e8-23983e7cca92 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:06.356666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-93411e7a-1b8b-47f6-b5e8-23983e7cca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:06.414692 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1363/2762] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:35:06.423024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f5f1-3374-451c-ba3d-7693d6ced0da None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.423315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f5f1-3374-451c-ba3d-7693d6ced0da None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.423593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f5f1-3374-451c-ba3d-7693d6ced0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.443112 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5a50f5f1-3374-451c-ba3d-7693d6ced0da None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:06.444263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5a50f5f1-3374-451c-ba3d-7693d6ced0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:06.452704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1400/2763] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:35:06.456870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93411e7a-1b8b-47f6-b5e8-23983e7cca92 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:06.466417 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93411e7a-1b8b-47f6-b5e8-23983e7cca92 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:06.471726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:06.472324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.472613 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.472893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.473598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:35:06.473908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:06.475540 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:06.486899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1364/2764] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:35:06.491008 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50f5f1-3374-451c-ba3d-7693d6ced0da None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:06.500456 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50f5f1-3374-451c-ba3d-7693d6ced0da None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:06.505027 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18197a-1948-4b64-b56f-f6f89124f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:06.505622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18197a-1948-4b64-b56f-f6f89124f63b admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.505900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18197a-1948-4b64-b56f-f6f89124f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.506173 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18197a-1948-4b64-b56f-f6f89124f63b admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.506878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18197a-1948-4b64-b56f-f6f89124f63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:06.508828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18197a-1948-4b64-b56f-f6f89124f63b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:06.538103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1401/2765] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:35:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:35:06.542127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:06.551983 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a786e-1103-4dff-85e3-8a1709bab2ca admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:06.606891 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c8efe-7619-4642-ab0d-77058dfb8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:06.607535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c8efe-7619-4642-ab0d-77058dfb8b41 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.607817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c8efe-7619-4642-ab0d-77058dfb8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.608095 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c8efe-7619-4642-ab0d-77058dfb8b41 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.608862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c8efe-7619-4642-ab0d-77058dfb8b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:06.610773 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c8efe-7619-4642-ab0d-77058dfb8b41 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:06.632251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1365/2766] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:35:06 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:35:06.636282 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18197a-1948-4b64-b56f-f6f89124f63b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:06.647015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18197a-1948-4b64-b56f-f6f89124f63b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:06.651879 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138140c-fdde-46de-aa3d-6e61b8f76a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:06.652488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138140c-fdde-46de-aa3d-6e61b8f76a09 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.652769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138140c-fdde-46de-aa3d-6e61b8f76a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.653042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138140c-fdde-46de-aa3d-6e61b8f76a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.653739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138140c-fdde-46de-aa3d-6e61b8f76a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:06.655980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138140c-fdde-46de-aa3d-6e61b8f76a09 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:06.665809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1402/2767] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:35:06.669451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c8efe-7619-4642-ab0d-77058dfb8b41 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:06.679570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c8efe-7619-4642-ab0d-77058dfb8b41 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:06.684155 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55495ef-ed50-4df8-bae7-1c8df494e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:06.684767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55495ef-ed50-4df8-bae7-1c8df494e0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.685054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55495ef-ed50-4df8-bae7-1c8df494e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.685335 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55495ef-ed50-4df8-bae7-1c8df494e0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.686027 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55495ef-ed50-4df8-bae7-1c8df494e0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:06.687659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55495ef-ed50-4df8-bae7-1c8df494e0b4 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:06.698066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1366/2768] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:35:06.701809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138140c-fdde-46de-aa3d-6e61b8f76a09 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:06.712012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138140c-fdde-46de-aa3d-6e61b8f76a09 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:06.716593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:06.717274 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.717554 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.718478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] PATH_INFO: `/v3/projects/e50b43adff634b54b7f3131d2501f596/users/37f17e8c245b40ff9e4e80877611a76a/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.732794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50b43adff634b54b7f3131d2501f596, user_id=37f17e8c245b40ff9e4e80877611a76a, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:06.735484 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:06.748032 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1403/2769] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:35:06 2022] PUT /identity/v3/projects/e50b43adff634b54b7f3131d2501f596/users/37f17e8c245b40ff9e4e80877611a76a/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:06.758371 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cbfcd-5d24-4cb6-ad23-e8e7f60e9e72 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.758664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cbfcd-5d24-4cb6-ad23-e8e7f60e9e72 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.758996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cbfcd-5d24-4cb6-ad23-e8e7f60e9e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.787582 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e01cbfcd-5d24-4cb6-ad23-e8e7f60e9e72 None None] MFA Rules not processed for user `37f17e8c245b40ff9e4e80877611a76a`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:06.788800 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e01cbfcd-5d24-4cb6-ad23-e8e7f60e9e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:06.796799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:06.854715 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1367/2770] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:35:06.865560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:06.867299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:06.874015 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:06.925407 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00debe17-e2f1-4036-9d96-bdff7c03b53d admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:06.929005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8777ae4-e568-4170-8134-fae2711874dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:06.929611 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777ae4-e568-4170-8134-fae2711874dd service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:06.929891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777ae4-e568-4170-8134-fae2711874dd service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:06.930160 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777ae4-e568-4170-8134-fae2711874dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:06.938763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8777ae4-e568-4170-8134-fae2711874dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:06.940211 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8777ae4-e568-4170-8134-fae2711874dd service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:06.949006 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1404/2771] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:35:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:35:16.851796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=23 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:16.944890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=24 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:17.355413 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cbfcd-5d24-4cb6-ad23-e8e7f60e9e72 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:17.424491 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cbfcd-5d24-4cb6-ad23-e8e7f60e9e72 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:17.428964 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:17.429594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:17.429873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:17.430142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] PATH_INFO: `/v3/users/37f17e8c245b40ff9e4e80877611a76a` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:17.431319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f17e8c245b40ff9e4e80877611a76a)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:17.433214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:17.480993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f17e8c245b40ff9e4e80877611a76a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:17.487976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f17e8c245b40ff9e4e80877611a76a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:17.488645 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f17e8c245b40ff9e4e80877611a76a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:17.501020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f17e8c245b40ff9e4e80877611a76a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:17.501664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f17e8c245b40ff9e4e80877611a76a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:17.514123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1368/2772] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:35:17 2022] DELETE /identity/v3/users/37f17e8c245b40ff9e4e80877611a76a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:17.519153 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd1dd5-9af3-462a-b401-f0b4f3cfed50 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:17.519446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd1dd5-9af3-462a-b401-f0b4f3cfed50 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:17.519776 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd1dd5-9af3-462a-b401-f0b4f3cfed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:17.539266 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-43bd1dd5-9af3-462a-b401-f0b4f3cfed50 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:17.540478 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-43bd1dd5-9af3-462a-b401-f0b4f3cfed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:17.598390 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1405/2773] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:35:17.607974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:17.609401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:17.666338 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8ef37-35cc-40f8-ab52-735db3e5864a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:17.670032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e603f4-bead-4200-bfeb-2d02ddca74ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:17.670647 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e603f4-bead-4200-bfeb-2d02ddca74ff service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:17.670956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e603f4-bead-4200-bfeb-2d02ddca74ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:17.671270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e603f4-bead-4200-bfeb-2d02ddca74ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:17.680146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e603f4-bead-4200-bfeb-2d02ddca74ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:17.681568 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e603f4-bead-4200-bfeb-2d02ddca74ff service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:17.691427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1369/2774] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:35:17.966706 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd1dd5-9af3-462a-b401-f0b4f3cfed50 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:17.968293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-43bd1dd5-9af3-462a-b401-f0b4f3cfed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:17.980816 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd1dd5-9af3-462a-b401-f0b4f3cfed50 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:17.985698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:17.986337 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:17.986621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:17.987054 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] PATH_INFO: `/v3/projects/e50b43adff634b54b7f3131d2501f596` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:17.988233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50b43adff634b54b7f3131d2501f596)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:17.990215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:18.041233 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50b43adff634b54b7f3131d2501f596', 'request_id': 'req-eda78567-02a8-4818-b900-77e400450158'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:18.049651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50b43adff634b54b7f3131d2501f596', 'request_id': 'req-eda78567-02a8-4818-b900-77e400450158'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:18.055356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50b43adff634b54b7f3131d2501f596', 'request_id': 'req-eda78567-02a8-4818-b900-77e400450158'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:18.067109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] The token cache is being invalidate because project e50b43adff634b54b7f3131d2501f596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:35:18.067400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:18.068061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-eda78567-02a8-4818-b900-77e400450158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:35:18.069569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1406/2775] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:35:17 2022] DELETE /identity/v3/projects/e50b43adff634b54b7f3131d2501f596 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:18.074489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1a14d-a9d1-4a8a-a813-3012fc3425d4 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.074976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1a14d-a9d1-4a8a-a813-3012fc3425d4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.075114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1a14d-a9d1-4a8a-a813-3012fc3425d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.093884 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-e6f1a14d-a9d1-4a8a-a813-3012fc3425d4 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:18.095114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e6f1a14d-a9d1-4a8a-a813-3012fc3425d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:18.112284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:18.158016 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1370/2776] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:35:18.166794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb421a7a-b26b-48a9-b99c-0ac57157ded1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.167118 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb421a7a-b26b-48a9-b99c-0ac57157ded1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.167425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb421a7a-b26b-48a9-b99c-0ac57157ded1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.188486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-bb421a7a-b26b-48a9-b99c-0ac57157ded1 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:18.189696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-bb421a7a-b26b-48a9-b99c-0ac57157ded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:18.197427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1407/2777] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:35:18.201632 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1a14d-a9d1-4a8a-a813-3012fc3425d4 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:18.211429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1a14d-a9d1-4a8a-a813-3012fc3425d4 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:18.216617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:18.217219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.217498 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.217772 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.218488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:35:18.218790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:18.220442 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:18.231940 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1371/2778] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:35:18.236416 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb421a7a-b26b-48a9-b99c-0ac57157ded1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:18.245702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb421a7a-b26b-48a9-b99c-0ac57157ded1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:18.251673 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b22ae-6bb2-4138-9f89-abe3ac33a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:18.252681 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b22ae-6bb2-4138-9f89-abe3ac33a7ae admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.252960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b22ae-6bb2-4138-9f89-abe3ac33a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.253230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b22ae-6bb2-4138-9f89-abe3ac33a7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.253892 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b22ae-6bb2-4138-9f89-abe3ac33a7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:18.255810 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b22ae-6bb2-4138-9f89-abe3ac33a7ae admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:18.281902 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1408/2779] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:35:18 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:35:18.286022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:18.295824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4387912-4fcf-4340-9706-da866d09e2c6 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:18.351116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb99c-dd1e-4a68-a57d-3a2f2deb09a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:18.351755 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb99c-dd1e-4a68-a57d-3a2f2deb09a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.352042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb99c-dd1e-4a68-a57d-3a2f2deb09a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.352314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bb99c-dd1e-4a68-a57d-3a2f2deb09a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.352970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb99c-dd1e-4a68-a57d-3a2f2deb09a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:18.354952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bb99c-dd1e-4a68-a57d-3a2f2deb09a5 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:18.376726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1372/2780] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:35:18 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:35:18.380908 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b22ae-6bb2-4138-9f89-abe3ac33a7ae admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:18.391310 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b22ae-6bb2-4138-9f89-abe3ac33a7ae admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:18.395954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac1972-6a02-4c26-80ef-703bbb35b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:18.396558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac1972-6a02-4c26-80ef-703bbb35b2bb admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.396842 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac1972-6a02-4c26-80ef-703bbb35b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.397119 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac1972-6a02-4c26-80ef-703bbb35b2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.397827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac1972-6a02-4c26-80ef-703bbb35b2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:18.399454 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac1972-6a02-4c26-80ef-703bbb35b2bb admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:18.409210 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1409/2781] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:35:18.412841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb99c-dd1e-4a68-a57d-3a2f2deb09a5 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:18.423135 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bb99c-dd1e-4a68-a57d-3a2f2deb09a5 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:18.427735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625cfd8-122a-4302-868c-db530ca5ba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:18.428338 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625cfd8-122a-4302-868c-db530ca5ba37 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.428621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625cfd8-122a-4302-868c-db530ca5ba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.428898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625cfd8-122a-4302-868c-db530ca5ba37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.429590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625cfd8-122a-4302-868c-db530ca5ba37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:18.431192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625cfd8-122a-4302-868c-db530ca5ba37 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:18.442191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1373/2782] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:35:18.446073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac1972-6a02-4c26-80ef-703bbb35b2bb admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:18.455956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac1972-6a02-4c26-80ef-703bbb35b2bb admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:18.460579 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:18.461226 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.461514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.461794 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] PATH_INFO: `/v3/projects/f4c853855a9649ab8cd07b37693e157a/users/b20f8b7488e94fbf979cb7c05a4ee66b/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.476988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c853855a9649ab8cd07b37693e157a, user_id=b20f8b7488e94fbf979cb7c05a4ee66b, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:18.479666 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:18.493394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1410/2783] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:35:18 2022] PUT /identity/v3/projects/f4c853855a9649ab8cd07b37693e157a/users/b20f8b7488e94fbf979cb7c05a4ee66b/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:35:18.503703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8465a2-80fa-49c9-8003-6b92c9c75fa4 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.504012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8465a2-80fa-49c9-8003-6b92c9c75fa4 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.504291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8465a2-80fa-49c9-8003-6b92c9c75fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.534720 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-dd8465a2-80fa-49c9-8003-6b92c9c75fa4 None None] MFA Rules not processed for user `b20f8b7488e94fbf979cb7c05a4ee66b`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:18.536158 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-dd8465a2-80fa-49c9-8003-6b92c9c75fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:18.601116 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1374/2784] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:35:18.612909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:18.614639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:18.636722 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:18.674531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8d55-d5e2-40e1-951e-1fe4fb0b3608 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:18.678194 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:18.678806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:18.679123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:18.679406 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:18.687631 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:18.689074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:18.697791 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1411/2785] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:35:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:35:23.225721 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4828-cc62-4f6d-bdb9-022f17833931 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:23.226219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4828-cc62-4f6d-bdb9-022f17833931 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:23.226219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4828-cc62-4f6d-bdb9-022f17833931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:23.245414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-136c4828-cc62-4f6d-bdb9-022f17833931 None None] MFA Rules not processed for user `24658f68ae194ce3a9ecdce7fdead2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:35:23.246618 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-136c4828-cc62-4f6d-bdb9-022f17833931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:23.258074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:23.301446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1375/2786] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:35:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:35:23.597021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:23.598451 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:23.654538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92aee-3373-464b-b548-f5e0bf345692 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:23.658688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:23.659331 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:23.659612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:23.659888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:23.661595 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:23.670822 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:23.672279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:23.680206 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1412/2787] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:35:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:35:33.294899 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=17 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:33.676583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=43 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:35:41.089886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4828-cc62-4f6d-bdb9-022f17833931 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:35:41.091366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-136c4828-cc62-4f6d-bdb9-022f17833931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:41.104726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4828-cc62-4f6d-bdb9-022f17833931 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:35:41.108804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619893a1-8979-4c29-b638-d737f8d0a0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:35:41.109600 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619893a1-8979-4c29-b638-d737f8d0a0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:35:41.109887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619893a1-8979-4c29-b638-d737f8d0a0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:35:41.110192 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619893a1-8979-4c29-b638-d737f8d0a0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:35:41.112629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-619893a1-8979-4c29-b638-d737f8d0a0a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:35:41.134149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619893a1-8979-4c29-b638-d737f8d0a0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:35:41.135783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619893a1-8979-4c29-b638-d737f8d0a0a0 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:35:41.145187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1376/2788] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:35:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:35:51.140307 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:36:09.440185 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:09.501051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24790117-44b3-4c7b-bc07-c214e8a40594 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:09.505505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:09.506132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:09.506412 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:09.506687 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] PATH_INFO: `/v3/users/b20f8b7488e94fbf979cb7c05a4ee66b` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:09.507884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20f8b7488e94fbf979cb7c05a4ee66b)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:09.509785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:09.555449 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20f8b7488e94fbf979cb7c05a4ee66b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:09.562345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20f8b7488e94fbf979cb7c05a4ee66b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:09.569230 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20f8b7488e94fbf979cb7c05a4ee66b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:09.569859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20f8b7488e94fbf979cb7c05a4ee66b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:09.581671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20f8b7488e94fbf979cb7c05a4ee66b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:09.588132 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1413/2789] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:36:09 2022] DELETE /identity/v3/users/b20f8b7488e94fbf979cb7c05a4ee66b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:36:09.592555 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70053-a2cb-4175-9f7a-b0b6788970b6 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:09.593029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70053-a2cb-4175-9f7a-b0b6788970b6 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:09.593119 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70053-a2cb-4175-9f7a-b0b6788970b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:09.612467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-42f70053-a2cb-4175-9f7a-b0b6788970b6 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:36:09.613681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-42f70053-a2cb-4175-9f7a-b0b6788970b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:09.671616 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1377/2790] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:36:09.681116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:09.682524 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:09.738849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7c9d3-0aa6-48af-96c3-cb79d1420dd3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:09.742910 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40008f03-7e23-4434-bfc2-b5ed1eabe29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:09.743558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40008f03-7e23-4434-bfc2-b5ed1eabe29e service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:09.743953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40008f03-7e23-4434-bfc2-b5ed1eabe29e service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:09.744262 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40008f03-7e23-4434-bfc2-b5ed1eabe29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:09.753157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40008f03-7e23-4434-bfc2-b5ed1eabe29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:09.755134 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40008f03-7e23-4434-bfc2-b5ed1eabe29e service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:09.764470 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1414/2791] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:36:10.028880 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70053-a2cb-4175-9f7a-b0b6788970b6 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.030354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-42f70053-a2cb-4175-9f7a-b0b6788970b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:10.042066 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70053-a2cb-4175-9f7a-b0b6788970b6 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.046660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.047332 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.047611 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.047882 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] PATH_INFO: `/v3/projects/f4c853855a9649ab8cd07b37693e157a` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.049035 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c853855a9649ab8cd07b37693e157a)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.050933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.098598 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c853855a9649ab8cd07b37693e157a', 'request_id': 'req-bf912c91-2e19-4e3a-ac0d-9471104c9f55'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.104659 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c853855a9649ab8cd07b37693e157a', 'request_id': 'req-bf912c91-2e19-4e3a-ac0d-9471104c9f55'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.111436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c853855a9649ab8cd07b37693e157a', 'request_id': 'req-bf912c91-2e19-4e3a-ac0d-9471104c9f55'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.122164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] The token cache is being invalidate because project f4c853855a9649ab8cd07b37693e157a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:36:10.122447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.123111 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-bf912c91-2e19-4e3a-ac0d-9471104c9f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.124593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1378/2792] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:36:10 2022] DELETE /identity/v3/projects/f4c853855a9649ab8cd07b37693e157a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:36:10.129378 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd26e2-bb4b-4acd-b7f0-b99dfe40ed1c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.130375 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd26e2-bb4b-4acd-b7f0-b99dfe40ed1c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.130658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd26e2-bb4b-4acd-b7f0-b99dfe40ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.149795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-3ffd26e2-bb4b-4acd-b7f0-b99dfe40ed1c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:36:10.151029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3ffd26e2-bb4b-4acd-b7f0-b99dfe40ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:10.167648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:36:10.210599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1415/2793] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:36:10.219249 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f07a2-0d27-4d9d-b31a-4f16406373b9 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.219535 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f07a2-0d27-4d9d-b31a-4f16406373b9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.219835 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f07a2-0d27-4d9d-b31a-4f16406373b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.242852 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-616f07a2-0d27-4d9d-b31a-4f16406373b9 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:36:10.244096 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-616f07a2-0d27-4d9d-b31a-4f16406373b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:10.251900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1379/2794] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:36:10.256812 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd26e2-bb4b-4acd-b7f0-b99dfe40ed1c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.266514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd26e2-bb4b-4acd-b7f0-b99dfe40ed1c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.271071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.271685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.271966 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.272240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.272930 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:36:10.273236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.274853 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.286921 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1416/2795] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:36:10.291050 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f07a2-0d27-4d9d-b31a-4f16406373b9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.299960 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f07a2-0d27-4d9d-b31a-4f16406373b9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.305081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414a64f-b9c9-4276-a83c-ebd86f0c61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.305679 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a64f-b9c9-4276-a83c-ebd86f0c61f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.305958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a64f-b9c9-4276-a83c-ebd86f0c61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.306230 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a64f-b9c9-4276-a83c-ebd86f0c61f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.306893 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414a64f-b9c9-4276-a83c-ebd86f0c61f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.309683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414a64f-b9c9-4276-a83c-ebd86f0c61f0 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.340717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1380/2796] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:36:10 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:36:10.345021 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.355269 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a307a70-efb6-467c-aa9f-cbbc71ee9d42 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.411343 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513833-bedc-4776-ac9a-a219c46ed9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.411956 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513833-bedc-4776-ac9a-a219c46ed9da admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.412235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513833-bedc-4776-ac9a-a219c46ed9da admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.412506 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513833-bedc-4776-ac9a-a219c46ed9da admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.413157 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513833-bedc-4776-ac9a-a219c46ed9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.415084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513833-bedc-4776-ac9a-a219c46ed9da admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.435741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1417/2797] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:36:10 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:36:10.439903 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414a64f-b9c9-4276-a83c-ebd86f0c61f0 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.450790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414a64f-b9c9-4276-a83c-ebd86f0c61f0 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.455365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b0306-dfc1-4e1f-893f-ee26b741cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.455970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0306-dfc1-4e1f-893f-ee26b741cdfd admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.456248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0306-dfc1-4e1f-893f-ee26b741cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.456519 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b0306-dfc1-4e1f-893f-ee26b741cdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.457208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b0306-dfc1-4e1f-893f-ee26b741cdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.458809 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b0306-dfc1-4e1f-893f-ee26b741cdfd admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.468508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1381/2798] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:36:10.472236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513833-bedc-4776-ac9a-a219c46ed9da admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.482415 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513833-bedc-4776-ac9a-a219c46ed9da admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.487045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad702a20-4ced-4417-b3f6-01fec12de273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.487642 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad702a20-4ced-4417-b3f6-01fec12de273 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.488011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad702a20-4ced-4417-b3f6-01fec12de273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.488284 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad702a20-4ced-4417-b3f6-01fec12de273 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.489065 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad702a20-4ced-4417-b3f6-01fec12de273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.491159 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad702a20-4ced-4417-b3f6-01fec12de273 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.501715 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1418/2799] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:36:10.505870 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b0306-dfc1-4e1f-893f-ee26b741cdfd admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.515727 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b0306-dfc1-4e1f-893f-ee26b741cdfd admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.520352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.521003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.521286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.521565 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] PATH_INFO: `/v3/projects/c660c246e28040f0a3967bd496230820/users/6188b3304ba04b6ca370208dee6f755c/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.536375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c660c246e28040f0a3967bd496230820, user_id=6188b3304ba04b6ca370208dee6f755c, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.539025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.552282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1382/2800] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:36:10 2022] PUT /identity/v3/projects/c660c246e28040f0a3967bd496230820/users/6188b3304ba04b6ca370208dee6f755c/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:36:10.562547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ca27-4203-4b06-8632-2fec8f0e60c1 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.562821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ca27-4203-4b06-8632-2fec8f0e60c1 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.563135 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ca27-4203-4b06-8632-2fec8f0e60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.589864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-b821ca27-4203-4b06-8632-2fec8f0e60c1 None None] MFA Rules not processed for user `6188b3304ba04b6ca370208dee6f755c`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:36:10.591104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-b821ca27-4203-4b06-8632-2fec8f0e60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:10.653068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1419/2801] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:36:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:36:10.664591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.666314 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:10.689591 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:36:10.725494 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79b9f8-9cf1-4183-ba45-8818cd4c7293 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.729046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094896-a286-4a96-89d8-45b14805eea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.729653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094896-a286-4a96-89d8-45b14805eea1 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.729931 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094896-a286-4a96-89d8-45b14805eea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.730203 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094896-a286-4a96-89d8-45b14805eea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.738309 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4094896-a286-4a96-89d8-45b14805eea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.740327 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4094896-a286-4a96-89d8-45b14805eea1 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.749191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1383/2802] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:36:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:36:10.773711 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ca27-4203-4b06-8632-2fec8f0e60c1 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:10.792690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:36:10.836929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ca27-4203-4b06-8632-2fec8f0e60c1 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:10.842505 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:10.843218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.843504 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.843789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] PATH_INFO: `/v3/users/6188b3304ba04b6ca370208dee6f755c` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.845005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6188b3304ba04b6ca370208dee6f755c)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:10.846954 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:10.893420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6188b3304ba04b6ca370208dee6f755c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.900693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6188b3304ba04b6ca370208dee6f755c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.907941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6188b3304ba04b6ca370208dee6f755c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.908581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6188b3304ba04b6ca370208dee6f755c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.920744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6188b3304ba04b6ca370208dee6f755c'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:10.926596 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1420/2803] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:36:10 2022] DELETE /identity/v3/users/6188b3304ba04b6ca370208dee6f755c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:36:10.931052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753b68-12f2-4e51-8d79-e43926efe423 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:10.931414 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753b68-12f2-4e51-8d79-e43926efe423 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:10.931789 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac753b68-12f2-4e51-8d79-e43926efe423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:10.950517 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-ac753b68-12f2-4e51-8d79-e43926efe423 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:36:10.951750 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ac753b68-12f2-4e51-8d79-e43926efe423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:11.009429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1384/2804] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:36:11.019000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:11.020929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:11.076863 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e147a-8224-4bb6-912c-3099ddfc94f3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:11.080521 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:11.081131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:11.081414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:11.081689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:11.091236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:11.092669 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:11.102632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1421/2805] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:36:11.364875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac753b68-12f2-4e51-8d79-e43926efe423 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:11.366438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-ac753b68-12f2-4e51-8d79-e43926efe423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:11.379103 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac753b68-12f2-4e51-8d79-e43926efe423 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:11.384492 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:11.385177 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:11.385460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:11.385738 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] PATH_INFO: `/v3/projects/c660c246e28040f0a3967bd496230820` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:11.386908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c660c246e28040f0a3967bd496230820)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:11.388846 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:11.435187 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c660c246e28040f0a3967bd496230820', 'request_id': 'req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:11.441433 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c660c246e28040f0a3967bd496230820', 'request_id': 'req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:11.449075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c660c246e28040f0a3967bd496230820', 'request_id': 'req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:11.459858 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] The token cache is being invalidate because project c660c246e28040f0a3967bd496230820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:36:11.460147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:11.460788 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-d60d4c4f-68b1-4b9b-829d-ad29d33d71bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:36:11.469421 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1385/2806] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:36:11 2022] DELETE /identity/v3/projects/c660c246e28040f0a3967bd496230820 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:36:21.097936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:36:21.456240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:36:43.870290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:36:43.871670 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:43.949987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8be63-a724-47d6-93f1-e421008e5605 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:36:44.009581 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:36:44.010193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:36:44.010474 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:36:44.010744 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:36:44.012489 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:36:44.023873 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:36:44.025425 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:36:44.035219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1422/2807] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:36:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:36:54.030951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=63 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:37:08.954129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952bcc-9c85-4d86-8c99-4ea875558b16 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:37:08.954624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952bcc-9c85-4d86-8c99-4ea875558b16 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:37:08.954723 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952bcc-9c85-4d86-8c99-4ea875558b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:37:08.973385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-9e952bcc-9c85-4d86-8c99-4ea875558b16 None None] MFA Rules not processed for user `24658f68ae194ce3a9ecdce7fdead2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:37:08.975133 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9e952bcc-9c85-4d86-8c99-4ea875558b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:37:09.029129 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1386/2808] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:37:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:37:19.022624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=25 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:37:34.013789 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:37:34.015345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:37:34.073693 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a482d2-3bab-4dca-9743-25d4359cda2d service placement] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:37:34.077315 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:37:34.077986 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:37:34.078208 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:37:34.078482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:37:34.080259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:37:34.090646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:37:34.092107 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:37:34.100203 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1423/2809] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:37:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:37:34.201545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e952bcc-9c85-4d86-8c99-4ea875558b16 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:37:34.203077 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9e952bcc-9c85-4d86-8c99-4ea875558b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:37:34.215570 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e952bcc-9c85-4d86-8c99-4ea875558b16 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:37:34.219184 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:37:34.219792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:37:34.220071 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:37:34.220340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:37:34.222044 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:37:34.290054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:37:34.291438 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:37:34.302024 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1387/2810] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:37:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:37:44.096532 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=26 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:37:44.297365 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=34 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:38:41.485188 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:38:41.486698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:38:41.517355 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c3114-3427-4d4c-b2d7-2119cec80ce1 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:38:41.522696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:38:41.523336 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:38:41.523615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:38:41.523888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:38:41.525763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:38:41.536131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:38:41.537736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:38:41.547545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1424/2811] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:38:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:38:42.954606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:38:42.956067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:38:43.032008 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281bdfe-f044-446e-8df0-7b16de0d45f8 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:38:43.035650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:38:43.036270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:38:43.036556 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:38:43.036832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:38:43.038628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:38:43.052385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:38:43.053915 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:38:43.065423 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1388/2812] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:38:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:38:50.845382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:38:50.855229 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045d460-2f3f-47d4-811f-a9cb881ec57b service nova] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:38:50.858803 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1f6d-eb1b-46ef-9cfa-c728641df41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:38:50.859448 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1f6d-eb1b-46ef-9cfa-c728641df41d service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:38:50.859729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1f6d-eb1b-46ef-9cfa-c728641df41d service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:38:50.860000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1f6d-eb1b-46ef-9cfa-c728641df41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:38:50.861768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5dbc1f6d-eb1b-46ef-9cfa-c728641df41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:38:50.876002 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc1f6d-eb1b-46ef-9cfa-c728641df41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:38:50.877437 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc1f6d-eb1b-46ef-9cfa-c728641df41d service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:38:50.889082 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1425/2813] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:38:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:38:53.060560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=31 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:38:55.105126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:38:55.117436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2bfe0-d461-496c-ae93-7fc8f0c660ee service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:38:55.123382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867e92c5301945a88e5c0ed06c4b7257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:38:55.124350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:38:55.124350 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:38:55.124549 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:38:55.126340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:38:55.140172 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:38:55.141778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:38:55.154167 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1389/2814] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:38:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:38:57.750570 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64bbcb-f1ff-4eec-8f3f-44b59e002250 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:38:57.751104 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64bbcb-f1ff-4eec-8f3f-44b59e002250 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:38:57.751199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64bbcb-f1ff-4eec-8f3f-44b59e002250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:38:57.770854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-7b64bbcb-f1ff-4eec-8f3f-44b59e002250 None None] MFA Rules not processed for user `24658f68ae194ce3a9ecdce7fdead2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:38:57.772098 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7b64bbcb-f1ff-4eec-8f3f-44b59e002250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:38:57.779180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1426/2815] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:38:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:39:05.148373 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=6 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:39:07.766056 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=20 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:39:30.577687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:39:30.587164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0d3b4-46e2-4e07-8b85-536eef1cab68 service nova] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:39:30.590719 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:39:30.591357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:39:30.591636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:39:30.591908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:39:30.593628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:39:30.655214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:39:30.656644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:39:30.667877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1390/2816] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:39:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:39:35.392270 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64bbcb-f1ff-4eec-8f3f-44b59e002250 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:39:35.402696 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64bbcb-f1ff-4eec-8f3f-44b59e002250 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:39:35.406216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:39:35.406817 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:39:35.407125 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:39:35.407404 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:39:35.409150 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:39:35.496354 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:39:35.497730 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:39:35.517894 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1427/2817] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:39:40.663608 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=28 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:39:41.628877 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:39:41.631049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:39:41.651451 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f8ecc-5fdc-4f84-8b34-066e4fdbddfd service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:39:41.663836 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:39:41.664485 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:39:41.664767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:39:41.665045 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:39:41.666872 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:39:41.681995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:39:41.687302 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:39:41.693249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:39:41.695382 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:39:41.699766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1391/2818] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:39:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:39:41.707769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93afc-0602-433c-8dfc-3a8d28a437f5 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:39:41.713128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:39:41.713766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:39:41.714049 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:39:41.714325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] PATH_INFO: `/v3/users/ac3dcec2976f433cbf562f4c30f72a35` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:39:41.715777 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3dcec2976f433cbf562f4c30f72a35)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:39:41.717688 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:39:41.766417 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3dcec2976f433cbf562f4c30f72a35'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:41.773826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3dcec2976f433cbf562f4c30f72a35'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:41.780886 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3dcec2976f433cbf562f4c30f72a35'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:41.781517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3dcec2976f433cbf562f4c30f72a35'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:41.794183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3dcec2976f433cbf562f4c30f72a35'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:41.800029 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1428/2819] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:39:41 2022] DELETE /identity/v3/users/ac3dcec2976f433cbf562f4c30f72a35 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:39:41.972246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:39:41.984038 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72778830-bdb6-453f-904b-e0dc75329148 service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:39:42.040735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:39:42.041378 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:39:42.041660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:39:42.041938 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] PATH_INFO: `/v3/projects/fc7e7a28f7c24dae9252a0afc9233ba3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:39:42.043123 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7e7a28f7c24dae9252a0afc9233ba3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:39:42.045022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:39:42.091401 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7e7a28f7c24dae9252a0afc9233ba3', 'request_id': 'req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.097366 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7e7a28f7c24dae9252a0afc9233ba3', 'request_id': 'req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.104190 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7e7a28f7c24dae9252a0afc9233ba3', 'request_id': 'req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.114832 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] The token cache is being invalidate because project fc7e7a28f7c24dae9252a0afc9233ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:39:42.115153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.115775 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.117381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1392/2820] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:39:41 2022] DELETE /identity/v3/projects/fc7e7a28f7c24dae9252a0afc9233ba3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:39:42.121483 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:39:42.122917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:39:42.136278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626b23c-7196-4d81-8bd5-b36306db0a08 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:39:42.170214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:39:42.195934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:39:42.196553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:39:42.196835 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:39:42.197114 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] PATH_INFO: `/v3/users/3277243733e34802bf732c356a57c831` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:39:42.198290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3277243733e34802bf732c356a57c831)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:39:42.200254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:39:42.245482 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3277243733e34802bf732c356a57c831'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.252629 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3277243733e34802bf732c356a57c831'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.260140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3277243733e34802bf732c356a57c831'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.260782 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3277243733e34802bf732c356a57c831'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.272976 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3277243733e34802bf732c356a57c831'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.278760 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1429/2821] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:39:42 2022] DELETE /identity/v3/users/3277243733e34802bf732c356a57c831 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:39:42.446440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:39:42.447889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:39:42.461660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e6b8-ae0c-41b4-8fd7-c39369c1646d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:39:42.518597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:39:42.519273 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:39:42.519554 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:39:42.519826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] PATH_INFO: `/v3/projects/3b1235c1ee6b454687cb8daa5127324b` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:39:42.521018 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1235c1ee6b454687cb8daa5127324b)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:39:42.523475 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:39:42.544685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:39:42.570948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1235c1ee6b454687cb8daa5127324b', 'request_id': 'req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.576946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1235c1ee6b454687cb8daa5127324b', 'request_id': 'req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.584240 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1235c1ee6b454687cb8daa5127324b', 'request_id': 'req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.594713 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] The token cache is being invalidate because project 3b1235c1ee6b454687cb8daa5127324b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:39:42.595040 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.595667 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:39:42.597189 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1393/2822] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:39:42 2022] DELETE /identity/v3/projects/3b1235c1ee6b454687cb8daa5127324b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:39:52.275321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:39:52.591890 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:40:44.481218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:44.482620 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:44.550011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e839-4bea-4a02-ad9d-a33c95181107 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:44.596560 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:44.597166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:44.597447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:44.597719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:44.599461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:44.660070 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:44.661486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:44.670903 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1430/2823] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:40:47.665248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:47.667946 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:47.729318 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:47.732507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:47.751234 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c85c5-34eb-4597-9f02-c0fa916efea2 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:47.756566 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:47.757072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:47.757356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:47.757621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d16e1-0ea1-4528-ac9d-2581d6c3e644 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:47.757727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] PATH_INFO: `/v3/users/24658f68ae194ce3a9ecdce7fdead2b9` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:47.758969 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24658f68ae194ce3a9ecdce7fdead2b9)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:47.760882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:47.763218 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:47.763842 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:47.764222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:47.764503 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:47.766270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:47.778180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:47.779802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:47.790718 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1394/2824] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:40:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:40:47.811861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24658f68ae194ce3a9ecdce7fdead2b9'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:47.814503 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:40:47.820736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24658f68ae194ce3a9ecdce7fdead2b9'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:47.829279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24658f68ae194ce3a9ecdce7fdead2b9'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:47.829929 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24658f68ae194ce3a9ecdce7fdead2b9'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:47.842348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-ed56f1a9-e677-47d8-8caf-22afaaa09cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24658f68ae194ce3a9ecdce7fdead2b9'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:47.848707 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1431/2825] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:40:47 2022] DELETE /identity/v3/users/24658f68ae194ce3a9ecdce7fdead2b9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:40:48.018412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.029994 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1e4d-3c1b-4850-abc2-e2fc7a81dc74 service placement] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.087703 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.088346 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.088629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.088902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] PATH_INFO: `/v3/projects/f829e581f6414c788ad1193f9168c3ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.090058 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f829e581f6414c788ad1193f9168c3ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.091993 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.137972 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f829e581f6414c788ad1193f9168c3ab', 'request_id': 'req-6a15097f-8f65-48ca-814c-a121bcc6e1f7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:48.144080 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f829e581f6414c788ad1193f9168c3ab', 'request_id': 'req-6a15097f-8f65-48ca-814c-a121bcc6e1f7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:48.151711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f829e581f6414c788ad1193f9168c3ab', 'request_id': 'req-6a15097f-8f65-48ca-814c-a121bcc6e1f7'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:48.161875 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] The token cache is being invalidate because project f829e581f6414c788ad1193f9168c3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:40:48.162165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:48.162791 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-6a15097f-8f65-48ca-814c-a121bcc6e1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:40:48.164427 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1395/2826] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:40:48 2022] DELETE /identity/v3/projects/f829e581f6414c788ad1193f9168c3ab => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:40:48.169429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d7974-d469-4478-85b2-7ffe03980ad7 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.169721 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d7974-d469-4478-85b2-7ffe03980ad7 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.170003 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d7974-d469-4478-85b2-7ffe03980ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.228321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-0b2d7974-d469-4478-85b2-7ffe03980ad7 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:40:48.229542 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0b2d7974-d469-4478-85b2-7ffe03980ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:48.287062 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1432/2827] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:40:48.295029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ba0b-47d3-4254-af20-06759a436ed2 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.295317 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ba0b-47d3-4254-af20-06759a436ed2 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.295597 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ba0b-47d3-4254-af20-06759a436ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.314665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-2a02ba0b-47d3-4254-af20-06759a436ed2 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:40:48.315916 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-2a02ba0b-47d3-4254-af20-06759a436ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:48.324195 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1396/2828] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:40:48.328420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d7974-d469-4478-85b2-7ffe03980ad7 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.338990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d7974-d469-4478-85b2-7ffe03980ad7 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.343488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.344090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.344367 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.344638 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.345328 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:40:48.345683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.347306 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.358481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1433/2829] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:40:48.362848 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02ba0b-47d3-4254-af20-06759a436ed2 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.372037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02ba0b-47d3-4254-af20-06759a436ed2 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.376650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcdb37-72aa-4467-99e8-53b5f91fee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.377248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdb37-72aa-4467-99e8-53b5f91fee82 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.377530 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdb37-72aa-4467-99e8-53b5f91fee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.377805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdb37-72aa-4467-99e8-53b5f91fee82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.378468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcdb37-72aa-4467-99e8-53b5f91fee82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.380388 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcdb37-72aa-4467-99e8-53b5f91fee82 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.392006 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:40:48.419623 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1397/2830] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:40:48 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:40:48.423178 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.433567 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf0600-a68a-4d36-81a8-3dfae42a64ff admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.488575 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19e1dc-2889-44ae-8a84-63977ebf3ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.489184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e1dc-2889-44ae-8a84-63977ebf3ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.489471 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e1dc-2889-44ae-8a84-63977ebf3ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.489751 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19e1dc-2889-44ae-8a84-63977ebf3ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.490959 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19e1dc-2889-44ae-8a84-63977ebf3ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.492874 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19e1dc-2889-44ae-8a84-63977ebf3ad0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.514286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1434/2831] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:40:48 2022] POST /identity/v3/users => generated 279 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:40:48.518333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcdb37-72aa-4467-99e8-53b5f91fee82 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.528526 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcdb37-72aa-4467-99e8-53b5f91fee82 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.533124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2efc0-f2a8-4107-b55f-57fa27287c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.533729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2efc0-f2a8-4107-b55f-57fa27287c86 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.534012 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2efc0-f2a8-4107-b55f-57fa27287c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.534286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2efc0-f2a8-4107-b55f-57fa27287c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.535020 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2efc0-f2a8-4107-b55f-57fa27287c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.536624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2efc0-f2a8-4107-b55f-57fa27287c86 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.547304 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1398/2832] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:40:48.551183 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19e1dc-2889-44ae-8a84-63977ebf3ad0 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.562231 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19e1dc-2889-44ae-8a84-63977ebf3ad0 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.566914 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6838ac1-51a5-4a75-bfc8-ac3d163cb394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.567559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838ac1-51a5-4a75-bfc8-ac3d163cb394 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.567844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838ac1-51a5-4a75-bfc8-ac3d163cb394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.569121 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838ac1-51a5-4a75-bfc8-ac3d163cb394 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.569396 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838ac1-51a5-4a75-bfc8-ac3d163cb394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.571017 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838ac1-51a5-4a75-bfc8-ac3d163cb394 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.583035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1435/2833] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:40:48.586244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2efc0-f2a8-4107-b55f-57fa27287c86 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.596336 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2efc0-f2a8-4107-b55f-57fa27287c86 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.601017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be9da-8356-4334-9f70-9e1e806f52c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.601670 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be9da-8356-4334-9f70-9e1e806f52c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.601958 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be9da-8356-4334-9f70-9e1e806f52c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.602238 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be9da-8356-4334-9f70-9e1e806f52c9 admin admin] PATH_INFO: `/v3/projects/27ea278158fb4674ba4ddfa2233429e5/users/c047fd07eb744dd4b92cdb8184b5d78f/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.617319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be9da-8356-4334-9f70-9e1e806f52c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ea278158fb4674ba4ddfa2233429e5, user_id=c047fd07eb744dd4b92cdb8184b5d78f, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.620047 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be9da-8356-4334-9f70-9e1e806f52c9 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.633383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1399/2834] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:40:48 2022] PUT /identity/v3/projects/27ea278158fb4674ba4ddfa2233429e5/users/c047fd07eb744dd4b92cdb8184b5d78f/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:40:48.644622 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349f8a-49ba-4071-b245-10b259ff7945 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.644909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349f8a-49ba-4071-b245-10b259ff7945 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.645184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69349f8a-49ba-4071-b245-10b259ff7945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.652286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:40:48.674628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-69349f8a-49ba-4071-b245-10b259ff7945 None None] MFA Rules not processed for user `c047fd07eb744dd4b92cdb8184b5d78f`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:40:48.675871 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-69349f8a-49ba-4071-b245-10b259ff7945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:48.739038 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1436/2835] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:40:48.744211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be9da-8356-4334-9f70-9e1e806f52c9 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.809256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be9da-8356-4334-9f70-9e1e806f52c9 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.813998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb8425-bdaf-4b40-908b-ec17770e8480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.814615 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8425-bdaf-4b40-908b-ec17770e8480 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.814947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8425-bdaf-4b40-908b-ec17770e8480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.815224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8425-bdaf-4b40-908b-ec17770e8480 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.815885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb8425-bdaf-4b40-908b-ec17770e8480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.817767 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb8425-bdaf-4b40-908b-ec17770e8480 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.843508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1400/2836] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:40:48 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:40:48.847882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349f8a-49ba-4071-b245-10b259ff7945 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.859110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69349f8a-49ba-4071-b245-10b259ff7945 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.914411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952c25c-420b-4694-95d0-278330643d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.915053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c25c-420b-4694-95d0-278330643d39 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.915333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c25c-420b-4694-95d0-278330643d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.915600 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c25c-420b-4694-95d0-278330643d39 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.916256 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952c25c-420b-4694-95d0-278330643d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.918154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952c25c-420b-4694-95d0-278330643d39 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.938796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1437/2837] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:40:48 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:40:48.943073 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb8425-bdaf-4b40-908b-ec17770e8480 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.953299 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb8425-bdaf-4b40-908b-ec17770e8480 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.957928 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a57ba-d8dc-43c6-8fef-2667f9e6041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.958533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a57ba-d8dc-43c6-8fef-2667f9e6041e admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.958815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a57ba-d8dc-43c6-8fef-2667f9e6041e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.959127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a57ba-d8dc-43c6-8fef-2667f9e6041e admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:48.959822 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a57ba-d8dc-43c6-8fef-2667f9e6041e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:48.961444 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a57ba-d8dc-43c6-8fef-2667f9e6041e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:48.972225 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1401/2838] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:40:48.976849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952c25c-420b-4694-95d0-278330643d39 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:48.986887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952c25c-420b-4694-95d0-278330643d39 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:48.992087 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35b78-2ad1-4bcb-a75d-33433b6c91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:48.992734 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35b78-2ad1-4bcb-a75d-33433b6c91c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:48.993013 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35b78-2ad1-4bcb-a75d-33433b6c91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:48.993286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35b78-2ad1-4bcb-a75d-33433b6c91c4 admin admin] PATH_INFO: `/v3/projects/4993a19c190b4b428c2ae99401f5cfb4/users/fee44978465a4decbdf6ac0c9e272a23/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:49.007535 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc35b78-2ad1-4bcb-a75d-33433b6c91c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4993a19c190b4b428c2ae99401f5cfb4, user_id=fee44978465a4decbdf6ac0c9e272a23, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:49.010152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc35b78-2ad1-4bcb-a75d-33433b6c91c4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:49.023129 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1438/2839] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:40:48 2022] PUT /identity/v3/projects/4993a19c190b4b428c2ae99401f5cfb4/users/fee44978465a4decbdf6ac0c9e272a23/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:40:49.027108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a57ba-d8dc-43c6-8fef-2667f9e6041e admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:49.037780 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a57ba-d8dc-43c6-8fef-2667f9e6041e admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:49.092545 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc445dda-036f-45f6-a1a1-25160e775675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:49.093094 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc445dda-036f-45f6-a1a1-25160e775675 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:49.093380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc445dda-036f-45f6-a1a1-25160e775675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:49.093657 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc445dda-036f-45f6-a1a1-25160e775675 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:49.094349 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc445dda-036f-45f6-a1a1-25160e775675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:49.095970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc445dda-036f-45f6-a1a1-25160e775675 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:49.105898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1402/2840] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:40:49.110000 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35b78-2ad1-4bcb-a75d-33433b6c91c4 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:49.121079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35b78-2ad1-4bcb-a75d-33433b6c91c4 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:49.125790 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:49.126453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:49.126739 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:49.127046 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] PATH_INFO: `/v3/projects/4993a19c190b4b428c2ae99401f5cfb4/users/fee44978465a4decbdf6ac0c9e272a23/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:49.129058 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4993a19c190b4b428c2ae99401f5cfb4, user_id=fee44978465a4decbdf6ac0c9e272a23, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:49.131719 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:49.141951 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1439/2841] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:40:49 2022] PUT /identity/v3/projects/4993a19c190b4b428c2ae99401f5cfb4/users/fee44978465a4decbdf6ac0c9e272a23/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:40:49.152729 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4d855-142b-476e-8ab4-2fffbcc74dd9 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:49.153015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4d855-142b-476e-8ab4-2fffbcc74dd9 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:49.153288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4d855-142b-476e-8ab4-2fffbcc74dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:49.181056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-96a4d855-142b-476e-8ab4-2fffbcc74dd9 None None] MFA Rules not processed for user `fee44978465a4decbdf6ac0c9e272a23`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:40:49.182253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-96a4d855-142b-476e-8ab4-2fffbcc74dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:49.187265 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:40:49.251900 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1403/2842] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:40:49 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:40:49.263071 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:49.264796 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:40:49.311728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:40:49.323175 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4953fd-01c9-45b0-895f-8c54da361ba4 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:49.326784 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344e7f5-4191-4ade-a64b-69812a3b0867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:49.327424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344e7f5-4191-4ade-a64b-69812a3b0867 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:49.327710 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344e7f5-4191-4ade-a64b-69812a3b0867 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:49.327988 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344e7f5-4191-4ade-a64b-69812a3b0867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:49.337654 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344e7f5-4191-4ade-a64b-69812a3b0867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:49.339162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344e7f5-4191-4ade-a64b-69812a3b0867 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:49.348727 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1440/2843] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:40:49 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:40:49.422947 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4d855-142b-476e-8ab4-2fffbcc74dd9 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:40:49.432626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4d855-142b-476e-8ab4-2fffbcc74dd9 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:40:49.436326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b5644-9181-46e7-aab8-4d839a4fff67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:40:49.436933 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b5644-9181-46e7-aab8-4d839a4fff67 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:40:49.437214 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b5644-9181-46e7-aab8-4d839a4fff67 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:40:49.437488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b5644-9181-46e7-aab8-4d839a4fff67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:40:49.493912 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b5644-9181-46e7-aab8-4d839a4fff67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:40:49.495379 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b5644-9181-46e7-aab8-4d839a4fff67 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:40:49.504242 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1404/2844] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:40:49 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 08:40:59.344399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:40:59.500150 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=54 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:04.167113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344e7f5-4191-4ade-a64b-69812a3b0867 service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:04.227102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344e7f5-4191-4ade-a64b-69812a3b0867 service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:04.231594 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:04.232220 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:04.232498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:04.232767 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] PATH_INFO: `/v3/users/c047fd07eb744dd4b92cdb8184b5d78f` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:04.233990 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c047fd07eb744dd4b92cdb8184b5d78f)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:04.236236 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:04.281752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c047fd07eb744dd4b92cdb8184b5d78f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.288740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c047fd07eb744dd4b92cdb8184b5d78f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.295795 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c047fd07eb744dd4b92cdb8184b5d78f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.296530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c047fd07eb744dd4b92cdb8184b5d78f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.308754 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c047fd07eb744dd4b92cdb8184b5d78f'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.314486 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1441/2845] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:04 2022] DELETE /identity/v3/users/c047fd07eb744dd4b92cdb8184b5d78f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:04.319076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061fa9-9602-4cf2-b8cf-dd2eb307f545 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:04.319544 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061fa9-9602-4cf2-b8cf-dd2eb307f545 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:04.319636 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b061fa9-9602-4cf2-b8cf-dd2eb307f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:04.340142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0b061fa9-9602-4cf2-b8cf-dd2eb307f545 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:04.341354 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0b061fa9-9602-4cf2-b8cf-dd2eb307f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:04.399569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1405/2846] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:04.409115 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:04.410522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:04.466464 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec0664-2166-431e-bb7b-2c5605e3690f admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:04.470165 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a6423-9aa4-4b76-9edf-821f3594a906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:04.470770 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a6423-9aa4-4b76-9edf-821f3594a906 service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:04.471084 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a6423-9aa4-4b76-9edf-821f3594a906 service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:04.471360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a6423-9aa4-4b76-9edf-821f3594a906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:04.480493 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a6423-9aa4-4b76-9edf-821f3594a906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:04.481909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a6423-9aa4-4b76-9edf-821f3594a906 service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:04.491530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1442/2847] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:04.752165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061fa9-9602-4cf2-b8cf-dd2eb307f545 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:04.753812 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0b061fa9-9602-4cf2-b8cf-dd2eb307f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:04.767955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b061fa9-9602-4cf2-b8cf-dd2eb307f545 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:04.772654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:04.773986 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:04.774419 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:04.774706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] PATH_INFO: `/v3/projects/27ea278158fb4674ba4ddfa2233429e5` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:04.776003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ea278158fb4674ba4ddfa2233429e5)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:04.777929 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:04.824745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ea278158fb4674ba4ddfa2233429e5', 'request_id': 'req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.830970 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ea278158fb4674ba4ddfa2233429e5', 'request_id': 'req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.838028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ea278158fb4674ba4ddfa2233429e5', 'request_id': 'req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.853222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] The token cache is being invalidate because project 27ea278158fb4674ba4ddfa2233429e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:04.853454 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.854420 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.856078 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1406/2848] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:04 2022] DELETE /identity/v3/projects/27ea278158fb4674ba4ddfa2233429e5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:04.860338 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a6423-9aa4-4b76-9edf-821f3594a906 service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:04.870865 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a6423-9aa4-4b76-9edf-821f3594a906 service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:04.888218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:04.928836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:04.929397 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:04.929675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:04.929948 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] PATH_INFO: `/v3/users/fee44978465a4decbdf6ac0c9e272a23` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:04.931224 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee44978465a4decbdf6ac0c9e272a23)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:04.933200 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:04.980228 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee44978465a4decbdf6ac0c9e272a23'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.987586 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee44978465a4decbdf6ac0c9e272a23'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.994353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee44978465a4decbdf6ac0c9e272a23'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:04.995005 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee44978465a4decbdf6ac0c9e272a23'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:05.007858 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-813abde2-2fda-4623-a410-4b5e2a6f56f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee44978465a4decbdf6ac0c9e272a23'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:05.013779 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1443/2849] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:04 2022] DELETE /identity/v3/users/fee44978465a4decbdf6ac0c9e272a23 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:41:05.271523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:05.273009 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:05.286799 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5094c5-2e60-4731-921f-fc44a4d1ee2b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:05.343709 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:05.344334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.344619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.344897 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] PATH_INFO: `/v3/projects/4993a19c190b4b428c2ae99401f5cfb4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.346049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4993a19c190b4b428c2ae99401f5cfb4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:05.347995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:05.378081 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:05.396182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4993a19c190b4b428c2ae99401f5cfb4', 'request_id': 'req-744e5de4-6602-41b4-b31c-756167c8d48d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:05.402918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4993a19c190b4b428c2ae99401f5cfb4', 'request_id': 'req-744e5de4-6602-41b4-b31c-756167c8d48d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:05.410054 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4993a19c190b4b428c2ae99401f5cfb4', 'request_id': 'req-744e5de4-6602-41b4-b31c-756167c8d48d'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:05.420288 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] The token cache is being invalidate because project 4993a19c190b4b428c2ae99401f5cfb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:05.420574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:05.421186 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-744e5de4-6602-41b4-b31c-756167c8d48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:05.422676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1407/2850] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:05 2022] DELETE /identity/v3/projects/4993a19c190b4b428c2ae99401f5cfb4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:05.427690 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80a55d-c581-4055-b5b6-9934f1b04b0c None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.428168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80a55d-c581-4055-b5b6-9934f1b04b0c None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.428400 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80a55d-c581-4055-b5b6-9934f1b04b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.448350 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-6a80a55d-c581-4055-b5b6-9934f1b04b0c None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:05.449480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6a80a55d-c581-4055-b5b6-9934f1b04b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:05.511517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1444/2851] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:05.520500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02b55-7f02-4f49-a82e-980b092ff51e None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.520790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02b55-7f02-4f49-a82e-980b092ff51e None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.521087 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02b55-7f02-4f49-a82e-980b092ff51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.540985 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-08e02b55-7f02-4f49-a82e-980b092ff51e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:05.542185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-08e02b55-7f02-4f49-a82e-980b092ff51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:05.549948 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1408/2852] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:05.554050 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80a55d-c581-4055-b5b6-9934f1b04b0c None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:05.563615 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80a55d-c581-4055-b5b6-9934f1b04b0c None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:05.568109 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:05.568737 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.569016 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.569288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.569978 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:41:05.570280 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:05.572389 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:05.583675 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1445/2853] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:41:05.588606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02b55-7f02-4f49-a82e-980b092ff51e None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:05.597776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02b55-7f02-4f49-a82e-980b092ff51e None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:05.602583 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33b074-2ee9-4581-840c-98eab9600189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:05.603221 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33b074-2ee9-4581-840c-98eab9600189 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.603500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33b074-2ee9-4581-840c-98eab9600189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.603778 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33b074-2ee9-4581-840c-98eab9600189 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.604449 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33b074-2ee9-4581-840c-98eab9600189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:05.606334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33b074-2ee9-4581-840c-98eab9600189 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:05.634758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1409/2854] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:05 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:05.638891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:05.648827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29424a51-22c6-439a-a5c2-b37ecd217a4c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:05.674391 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:05.707249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632da0-2e05-4f24-958b-dc635c6bec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:05.707797 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632da0-2e05-4f24-958b-dc635c6bec46 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.708081 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632da0-2e05-4f24-958b-dc635c6bec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.708360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632da0-2e05-4f24-958b-dc635c6bec46 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.709031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35632da0-2e05-4f24-958b-dc635c6bec46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:05.710974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35632da0-2e05-4f24-958b-dc635c6bec46 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:05.731348 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1446/2855] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:05 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:05.735699 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33b074-2ee9-4581-840c-98eab9600189 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:05.746455 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33b074-2ee9-4581-840c-98eab9600189 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:05.751075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da03-ef0f-4645-a351-6a680f352d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:05.751694 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da03-ef0f-4645-a351-6a680f352d56 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.751976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da03-ef0f-4645-a351-6a680f352d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.752248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da03-ef0f-4645-a351-6a680f352d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.752942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0da03-ef0f-4645-a351-6a680f352d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:05.754521 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0da03-ef0f-4645-a351-6a680f352d56 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:05.765235 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1410/2856] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:05.769025 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632da0-2e05-4f24-958b-dc635c6bec46 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:05.778809 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632da0-2e05-4f24-958b-dc635c6bec46 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:05.783366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea02a2-2161-43f5-808c-57b06889f75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:05.783962 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea02a2-2161-43f5-808c-57b06889f75a admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.784240 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea02a2-2161-43f5-808c-57b06889f75a admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.784510 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea02a2-2161-43f5-808c-57b06889f75a admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.785192 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea02a2-2161-43f5-808c-57b06889f75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:05.786759 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea02a2-2161-43f5-808c-57b06889f75a admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:05.797110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1447/2857] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:05.800886 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da03-ef0f-4645-a351-6a680f352d56 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:05.811107 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da03-ef0f-4645-a351-6a680f352d56 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:05.815683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeef4a5-3f69-4803-9043-0058d9167302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:05.816337 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeef4a5-3f69-4803-9043-0058d9167302 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.816617 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeef4a5-3f69-4803-9043-0058d9167302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.816889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeef4a5-3f69-4803-9043-0058d9167302 admin admin] PATH_INFO: `/v3/projects/8d013a204b194667b20dec821d2b1028/users/36cd99e66bbd4bd39a55e61db3631355/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.831653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeef4a5-3f69-4803-9043-0058d9167302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d013a204b194667b20dec821d2b1028, user_id=36cd99e66bbd4bd39a55e61db3631355, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:05.834323 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeef4a5-3f69-4803-9043-0058d9167302 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:05.848209 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1411/2858] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:05 2022] PUT /identity/v3/projects/8d013a204b194667b20dec821d2b1028/users/36cd99e66bbd4bd39a55e61db3631355/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:05.858659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2fae-c3f3-4c63-b191-c37891dda9c8 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:05.858950 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2fae-c3f3-4c63-b191-c37891dda9c8 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:05.859239 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2fae-c3f3-4c63-b191-c37891dda9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:05.887953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a73d2fae-c3f3-4c63-b191-c37891dda9c8 None None] MFA Rules not processed for user `36cd99e66bbd4bd39a55e61db3631355`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:05.889163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a73d2fae-c3f3-4c63-b191-c37891dda9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:05.951621 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1448/2859] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:05.956061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeef4a5-3f69-4803-9043-0058d9167302 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.016049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeef4a5-3f69-4803-9043-0058d9167302 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.020761 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b25a11-4efe-4d55-accf-e978cff01547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.021374 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25a11-4efe-4d55-accf-e978cff01547 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.021653 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25a11-4efe-4d55-accf-e978cff01547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.021926 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25a11-4efe-4d55-accf-e978cff01547 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.022580 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b25a11-4efe-4d55-accf-e978cff01547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.024537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b25a11-4efe-4d55-accf-e978cff01547 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.053529 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1412/2860] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:05 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:06.058384 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d2fae-c3f3-4c63-b191-c37891dda9c8 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.068961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d2fae-c3f3-4c63-b191-c37891dda9c8 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.123533 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31bba-606e-4474-8a77-00a422739388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.124142 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31bba-606e-4474-8a77-00a422739388 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.124422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31bba-606e-4474-8a77-00a422739388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.124698 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31bba-606e-4474-8a77-00a422739388 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.125362 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa31bba-606e-4474-8a77-00a422739388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.127299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa31bba-606e-4474-8a77-00a422739388 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.147439 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1449/2861] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:06 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:06.151281 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b25a11-4efe-4d55-accf-e978cff01547 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.161569 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b25a11-4efe-4d55-accf-e978cff01547 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.166804 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed2f25-24f9-4d8a-9ed3-2fad712eefdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.167440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed2f25-24f9-4d8a-9ed3-2fad712eefdc admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.167726 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed2f25-24f9-4d8a-9ed3-2fad712eefdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.168010 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed2f25-24f9-4d8a-9ed3-2fad712eefdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.168735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed2f25-24f9-4d8a-9ed3-2fad712eefdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.170400 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed2f25-24f9-4d8a-9ed3-2fad712eefdc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.181566 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1413/2862] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:06.185487 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31bba-606e-4474-8a77-00a422739388 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.195432 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31bba-606e-4474-8a77-00a422739388 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.199980 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019ce81-2965-4ad9-b15e-fc4bf6dfb744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.200583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019ce81-2965-4ad9-b15e-fc4bf6dfb744 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.200866 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019ce81-2965-4ad9-b15e-fc4bf6dfb744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.201143 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019ce81-2965-4ad9-b15e-fc4bf6dfb744 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.201837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019ce81-2965-4ad9-b15e-fc4bf6dfb744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.203462 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019ce81-2965-4ad9-b15e-fc4bf6dfb744 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.213429 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1450/2863] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:06.217207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed2f25-24f9-4d8a-9ed3-2fad712eefdc admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.227001 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed2f25-24f9-4d8a-9ed3-2fad712eefdc admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.232023 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9c769-8ab5-4c53-aa68-14d8ea63727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.232664 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9c769-8ab5-4c53-aa68-14d8ea63727b admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.232944 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9c769-8ab5-4c53-aa68-14d8ea63727b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.233219 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9c769-8ab5-4c53-aa68-14d8ea63727b admin admin] PATH_INFO: `/v3/projects/027dcdbbf7b84a43ae479d17927cc8b0/users/731ce40996af40d0b370381ae0c398fd/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.248114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9c769-8ab5-4c53-aa68-14d8ea63727b admin admin] RBAC: Authorizing `identity:create_grant(project_id=027dcdbbf7b84a43ae479d17927cc8b0, user_id=731ce40996af40d0b370381ae0c398fd, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.250711 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9c769-8ab5-4c53-aa68-14d8ea63727b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.259003 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:06.264136 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1414/2864] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:06 2022] PUT /identity/v3/projects/027dcdbbf7b84a43ae479d17927cc8b0/users/731ce40996af40d0b370381ae0c398fd/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:41:06.275263 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0365cf2-19c5-4aea-8e16-eb39d16ce005 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.275499 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0365cf2-19c5-4aea-8e16-eb39d16ce005 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.275775 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0365cf2-19c5-4aea-8e16-eb39d16ce005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.302828 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-a0365cf2-19c5-4aea-8e16-eb39d16ce005 None None] MFA Rules not processed for user `731ce40996af40d0b370381ae0c398fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:06.304045 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a0365cf2-19c5-4aea-8e16-eb39d16ce005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:06.308562 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:06.370573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1451/2865] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:06.375042 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9c769-8ab5-4c53-aa68-14d8ea63727b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.436183 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9c769-8ab5-4c53-aa68-14d8ea63727b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.440802 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc225e-4491-44e9-a3cf-67289fc0ae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.441406 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc225e-4491-44e9-a3cf-67289fc0ae89 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.441685 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc225e-4491-44e9-a3cf-67289fc0ae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.441955 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc225e-4491-44e9-a3cf-67289fc0ae89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.442621 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc225e-4491-44e9-a3cf-67289fc0ae89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.444606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc225e-4491-44e9-a3cf-67289fc0ae89 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.470048 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1415/2866] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:06 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:06.474068 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0365cf2-19c5-4aea-8e16-eb39d16ce005 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.485345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0365cf2-19c5-4aea-8e16-eb39d16ce005 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.539278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af662a48-7f33-4807-8394-a1195ed502e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.540373 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662a48-7f33-4807-8394-a1195ed502e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.540709 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662a48-7f33-4807-8394-a1195ed502e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.540992 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af662a48-7f33-4807-8394-a1195ed502e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.541652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af662a48-7f33-4807-8394-a1195ed502e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.543634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af662a48-7f33-4807-8394-a1195ed502e5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.563963 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1452/2867] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:06 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:06.567887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc225e-4491-44e9-a3cf-67289fc0ae89 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.578026 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc225e-4491-44e9-a3cf-67289fc0ae89 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.582619 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571176e-d2c7-48bb-a85e-02cf37ddbdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.583255 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571176e-d2c7-48bb-a85e-02cf37ddbdfa admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.583539 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571176e-d2c7-48bb-a85e-02cf37ddbdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.583811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571176e-d2c7-48bb-a85e-02cf37ddbdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.584500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571176e-d2c7-48bb-a85e-02cf37ddbdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.586083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571176e-d2c7-48bb-a85e-02cf37ddbdfa admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.596876 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1416/2868] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:06.600651 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af662a48-7f33-4807-8394-a1195ed502e5 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.611413 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af662a48-7f33-4807-8394-a1195ed502e5 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.615991 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d116-dba0-44de-996b-a570c82406ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.616641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d116-dba0-44de-996b-a570c82406ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.616923 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d116-dba0-44de-996b-a570c82406ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.617198 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d116-dba0-44de-996b-a570c82406ab admin admin] PATH_INFO: `/v3/projects/25ba88ef1dc64467bd8254fdb4289c22/users/9bbb653fc8ec4ed8a9a2a3522ec17655/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.631498 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9d116-dba0-44de-996b-a570c82406ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ba88ef1dc64467bd8254fdb4289c22, user_id=9bbb653fc8ec4ed8a9a2a3522ec17655, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.634127 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9d116-dba0-44de-996b-a570c82406ab admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.646639 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1453/2869] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:06 2022] PUT /identity/v3/projects/25ba88ef1dc64467bd8254fdb4289c22/users/9bbb653fc8ec4ed8a9a2a3522ec17655/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:06.650911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571176e-d2c7-48bb-a85e-02cf37ddbdfa admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.660795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571176e-d2c7-48bb-a85e-02cf37ddbdfa admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.715988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42a6e4-6ccf-49bd-a7da-1b34d7b95151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.716593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a6e4-6ccf-49bd-a7da-1b34d7b95151 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.716873 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a6e4-6ccf-49bd-a7da-1b34d7b95151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.717146 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a6e4-6ccf-49bd-a7da-1b34d7b95151 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.717831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42a6e4-6ccf-49bd-a7da-1b34d7b95151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.719447 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42a6e4-6ccf-49bd-a7da-1b34d7b95151 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.729662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1417/2870] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:06.733826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d116-dba0-44de-996b-a570c82406ab admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.744438 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d116-dba0-44de-996b-a570c82406ab admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.749111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.749769 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.750053 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.750332 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] PATH_INFO: `/v3/projects/25ba88ef1dc64467bd8254fdb4289c22/users/9bbb653fc8ec4ed8a9a2a3522ec17655/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.752363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ba88ef1dc64467bd8254fdb4289c22, user_id=9bbb653fc8ec4ed8a9a2a3522ec17655, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.755022 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.765689 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1454/2871] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:06 2022] PUT /identity/v3/projects/25ba88ef1dc64467bd8254fdb4289c22/users/9bbb653fc8ec4ed8a9a2a3522ec17655/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:06.776256 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3282da0-b9fc-4f51-95c8-ee1880c553ef None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.776574 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3282da0-b9fc-4f51-95c8-ee1880c553ef None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.776855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3282da0-b9fc-4f51-95c8-ee1880c553ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.803593 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-a3282da0-b9fc-4f51-95c8-ee1880c553ef None None] MFA Rules not processed for user `9bbb653fc8ec4ed8a9a2a3522ec17655`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:06.804724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a3282da0-b9fc-4f51-95c8-ee1880c553ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:06.862914 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:06.873191 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1418/2872] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 08:41:06.884591 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:06.886307 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:06.942547 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ce8f-67fd-4bb9-ac9d-a44d63996e73 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:06.946668 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2bcb-3722-45d5-b168-2de8fe9a779a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:06.947302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2bcb-3722-45d5-b168-2de8fe9a779a service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:06.947578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2bcb-3722-45d5-b168-2de8fe9a779a service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:06.947878 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2bcb-3722-45d5-b168-2de8fe9a779a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:06.956763 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b2bcb-3722-45d5-b168-2de8fe9a779a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:06.958174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b2bcb-3722-45d5-b168-2de8fe9a779a service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:06.963755 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:06.968890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1455/2873] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:07.008924 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3282da0-b9fc-4f51-95c8-ee1880c553ef None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:07.010380 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a3282da0-b9fc-4f51-95c8-ee1880c553ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:07.023274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3282da0-b9fc-4f51-95c8-ee1880c553ef None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:07.027824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e5ae-6c46-4105-bd1b-bd06d023ef0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:07.028437 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e5ae-6c46-4105-bd1b-bd06d023ef0b service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:07.028717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e5ae-6c46-4105-bd1b-bd06d023ef0b service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:07.028988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e5ae-6c46-4105-bd1b-bd06d023ef0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:07.087246 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856e5ae-6c46-4105-bd1b-bd06d023ef0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:07.088691 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856e5ae-6c46-4105-bd1b-bd06d023ef0b service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:07.097500 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1419/2874] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:09.941716 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2bcb-3722-45d5-b168-2de8fe9a779a service cinder] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:10.002555 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2bcb-3722-45d5-b168-2de8fe9a779a service cinder] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:10.007079 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:10.007712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:10.008010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:10.008272 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] PATH_INFO: `/v3/users/36cd99e66bbd4bd39a55e61db3631355` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:10.009447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cd99e66bbd4bd39a55e61db3631355)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:10.011399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:10.055877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cd99e66bbd4bd39a55e61db3631355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.063244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cd99e66bbd4bd39a55e61db3631355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.070155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cd99e66bbd4bd39a55e61db3631355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.070802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cd99e66bbd4bd39a55e61db3631355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.082480 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cd99e66bbd4bd39a55e61db3631355'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.088235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1456/2875] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:09 2022] DELETE /identity/v3/users/36cd99e66bbd4bd39a55e61db3631355 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:10.092642 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4d4d-9611-478e-a74a-256d95f0c977 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:10.093114 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4d4d-9611-478e-a74a-256d95f0c977 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:10.093211 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4d4d-9611-478e-a74a-256d95f0c977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:10.112245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-07cf4d4d-9611-478e-a74a-256d95f0c977 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:10.113376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-07cf4d4d-9611-478e-a74a-256d95f0c977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:10.171086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1420/2876] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:10.181288 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:10.182714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:10.239580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3608d-2eb8-4700-88a5-3b23fd72af94 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:10.243199 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6fa0f-9c2b-45ea-873f-10b6bb961c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:10.243811 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fa0f-9c2b-45ea-873f-10b6bb961c2d service neutron] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:10.244090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fa0f-9c2b-45ea-873f-10b6bb961c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:10.244364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fa0f-9c2b-45ea-873f-10b6bb961c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:10.254080 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6fa0f-9c2b-45ea-873f-10b6bb961c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:10.255583 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6fa0f-9c2b-45ea-873f-10b6bb961c2d service neutron] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:10.268214 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1457/2877] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:10.527093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf4d4d-9611-478e-a74a-256d95f0c977 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:10.528518 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-07cf4d4d-9611-478e-a74a-256d95f0c977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:10.540841 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf4d4d-9611-478e-a74a-256d95f0c977 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:10.545376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:10.546017 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:10.546300 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:10.546573 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] PATH_INFO: `/v3/projects/8d013a204b194667b20dec821d2b1028` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:10.547766 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d013a204b194667b20dec821d2b1028)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:10.549683 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:10.595860 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d013a204b194667b20dec821d2b1028', 'request_id': 'req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.601956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d013a204b194667b20dec821d2b1028', 'request_id': 'req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.608785 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d013a204b194667b20dec821d2b1028', 'request_id': 'req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.619375 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] The token cache is being invalidate because project 8d013a204b194667b20dec821d2b1028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:10.619660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.620270 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.621831 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1421/2878] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:10 2022] DELETE /identity/v3/projects/8d013a204b194667b20dec821d2b1028 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:10.625859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6fa0f-9c2b-45ea-873f-10b6bb961c2d service neutron] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:10.636193 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6fa0f-9c2b-45ea-873f-10b6bb961c2d service neutron] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:10.655623 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:10.695435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:10.696568 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:10.696844 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:10.697110 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] PATH_INFO: `/v3/users/731ce40996af40d0b370381ae0c398fd` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:10.698278 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731ce40996af40d0b370381ae0c398fd)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:10.700216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:10.744195 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731ce40996af40d0b370381ae0c398fd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.751201 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731ce40996af40d0b370381ae0c398fd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.758800 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731ce40996af40d0b370381ae0c398fd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.759546 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731ce40996af40d0b370381ae0c398fd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.771618 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731ce40996af40d0b370381ae0c398fd'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:10.777979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1458/2879] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:10 2022] DELETE /identity/v3/users/731ce40996af40d0b370381ae0c398fd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:11.053562 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:11.055687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:11.075833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9b738-65cb-41a9-9a56-c90cd2ce1501 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:11.090324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:11.138460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:11.139153 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:11.139422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:11.139700 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] PATH_INFO: `/v3/projects/027dcdbbf7b84a43ae479d17927cc8b0` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:11.140952 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=027dcdbbf7b84a43ae479d17927cc8b0)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:11.142889 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:11.191245 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027dcdbbf7b84a43ae479d17927cc8b0', 'request_id': 'req-47e02c8b-3725-4e01-9328-ff85f00dcb7a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.198015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027dcdbbf7b84a43ae479d17927cc8b0', 'request_id': 'req-47e02c8b-3725-4e01-9328-ff85f00dcb7a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.205261 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027dcdbbf7b84a43ae479d17927cc8b0', 'request_id': 'req-47e02c8b-3725-4e01-9328-ff85f00dcb7a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.215457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] The token cache is being invalidate because project 027dcdbbf7b84a43ae479d17927cc8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:11.215743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.216361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.217869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1422/2880] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:11 2022] DELETE /identity/v3/projects/027dcdbbf7b84a43ae479d17927cc8b0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:11.221808 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:11.223276 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:11.236345 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76efbcb-8093-4ac7-a20f-847fe91c1cf3 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:11.293394 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:11.294036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:11.294321 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:11.294601 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] PATH_INFO: `/v3/users/9bbb653fc8ec4ed8a9a2a3522ec17655` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:11.295799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbb653fc8ec4ed8a9a2a3522ec17655)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:11.297723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:11.340435 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:11.343212 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbb653fc8ec4ed8a9a2a3522ec17655'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.351041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbb653fc8ec4ed8a9a2a3522ec17655'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.358893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbb653fc8ec4ed8a9a2a3522ec17655'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.359549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbb653fc8ec4ed8a9a2a3522ec17655'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.372541 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-2c661386-b006-4100-ae5c-b3c19bd978d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbb653fc8ec4ed8a9a2a3522ec17655'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.378285 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1459/2881] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:11 2022] DELETE /identity/v3/users/9bbb653fc8ec4ed8a9a2a3522ec17655 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:11.657471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:11.659025 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:11.678910 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02c8b-3725-4e01-9328-ff85f00dcb7a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:11.736063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:11.736628 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:11.736911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:11.737223 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] PATH_INFO: `/v3/projects/25ba88ef1dc64467bd8254fdb4289c22` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:11.738385 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ba88ef1dc64467bd8254fdb4289c22)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:11.740352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:11.785684 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ba88ef1dc64467bd8254fdb4289c22', 'request_id': 'req-ff7beb73-1e5b-44bb-bffe-d49448a4b319'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.786777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:11.793866 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ba88ef1dc64467bd8254fdb4289c22', 'request_id': 'req-ff7beb73-1e5b-44bb-bffe-d49448a4b319'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.801067 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ba88ef1dc64467bd8254fdb4289c22', 'request_id': 'req-ff7beb73-1e5b-44bb-bffe-d49448a4b319'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.811180 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] The token cache is being invalidate because project 25ba88ef1dc64467bd8254fdb4289c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91861) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:11.811467 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.812093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-ff7beb73-1e5b-44bb-bffe-d49448a4b319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:11.813594 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1423/2882] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:11 2022] DELETE /identity/v3/projects/25ba88ef1dc64467bd8254fdb4289c22 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:11.819461 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3681a-8035-4f33-afd1-178dbdceef6f None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:11.819757 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3681a-8035-4f33-afd1-178dbdceef6f None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:11.820041 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3681a-8035-4f33-afd1-178dbdceef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:11.843166 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-80b3681a-8035-4f33-afd1-178dbdceef6f None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:11.844399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-80b3681a-8035-4f33-afd1-178dbdceef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:11.906072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1460/2883] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:11.915074 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca1e7-6bc6-4818-9dc9-eefe689b0913 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:11.915369 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca1e7-6bc6-4818-9dc9-eefe689b0913 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:11.915646 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aca1e7-6bc6-4818-9dc9-eefe689b0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:11.934819 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-91aca1e7-6bc6-4818-9dc9-eefe689b0913 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:11.936052 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-91aca1e7-6bc6-4818-9dc9-eefe689b0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:11.943855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1424/2884] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:11.947934 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3681a-8035-4f33-afd1-178dbdceef6f None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:11.957664 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3681a-8035-4f33-afd1-178dbdceef6f None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:11.962785 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:11.963427 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:11.963712 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:11.963987 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:11.964728 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:41:11.965035 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:11.966637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:11.978787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1461/2885] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:41:11.983161 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aca1e7-6bc6-4818-9dc9-eefe689b0913 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:11.992706 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aca1e7-6bc6-4818-9dc9-eefe689b0913 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:11.997263 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971988-d54e-4f28-9485-8216031f1d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:11.997864 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971988-d54e-4f28-9485-8216031f1d2d admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:11.998148 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971988-d54e-4f28-9485-8216031f1d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:11.998424 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971988-d54e-4f28-9485-8216031f1d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:11.999124 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971988-d54e-4f28-9485-8216031f1d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.001037 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971988-d54e-4f28-9485-8216031f1d2d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.028394 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1425/2886] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:11 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:12.032392 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.042512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8309a7-a620-4c82-8c69-55875c2718a8 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.097522 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c1eae-6be9-4c8c-a697-610c3b119ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.098130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1eae-6be9-4c8c-a697-610c3b119ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.098411 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1eae-6be9-4c8c-a697-610c3b119ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.098685 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1eae-6be9-4c8c-a697-610c3b119ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.099381 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c1eae-6be9-4c8c-a697-610c3b119ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.101297 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c1eae-6be9-4c8c-a697-610c3b119ef9 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.121512 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1462/2887] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:12 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:12.125592 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971988-d54e-4f28-9485-8216031f1d2d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.136208 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971988-d54e-4f28-9485-8216031f1d2d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.140942 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2368620-beef-40b8-b1c5-d7b662d7d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.141543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2368620-beef-40b8-b1c5-d7b662d7d772 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.141821 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2368620-beef-40b8-b1c5-d7b662d7d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.142093 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2368620-beef-40b8-b1c5-d7b662d7d772 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.142783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2368620-beef-40b8-b1c5-d7b662d7d772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.144410 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2368620-beef-40b8-b1c5-d7b662d7d772 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.154648 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1426/2888] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:12.158374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c1eae-6be9-4c8c-a697-610c3b119ef9 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.168539 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c1eae-6be9-4c8c-a697-610c3b119ef9 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.173460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef917b-adfa-4819-8daa-985a7d5f0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.174094 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef917b-adfa-4819-8daa-985a7d5f0613 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.174374 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef917b-adfa-4819-8daa-985a7d5f0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.174647 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef917b-adfa-4819-8daa-985a7d5f0613 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.175405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef917b-adfa-4819-8daa-985a7d5f0613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.177030 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef917b-adfa-4819-8daa-985a7d5f0613 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.187545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1463/2889] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:12.191478 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2368620-beef-40b8-b1c5-d7b662d7d772 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.201817 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2368620-beef-40b8-b1c5-d7b662d7d772 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.206489 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ad07f-5cde-4a9a-aab2-9bf570e2677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.207165 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad07f-5cde-4a9a-aab2-9bf570e2677a admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.207457 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad07f-5cde-4a9a-aab2-9bf570e2677a admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.207736 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad07f-5cde-4a9a-aab2-9bf570e2677a admin admin] PATH_INFO: `/v3/projects/e4a983becef64a00945da7fe9611455c/users/ed3c376c6fff4cf8b1d1d684da93b5d4/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.222439 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ad07f-5cde-4a9a-aab2-9bf570e2677a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a983becef64a00945da7fe9611455c, user_id=ed3c376c6fff4cf8b1d1d684da93b5d4, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.225108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ad07f-5cde-4a9a-aab2-9bf570e2677a admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.237839 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1427/2890] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:12 2022] PUT /identity/v3/projects/e4a983becef64a00945da7fe9611455c/users/ed3c376c6fff4cf8b1d1d684da93b5d4/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:12.250031 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12e8c7-ced9-4a95-b771-d2b2e409e355 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.250491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12e8c7-ced9-4a95-b771-d2b2e409e355 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.250491 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12e8c7-ced9-4a95-b771-d2b2e409e355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.278215 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-5d12e8c7-ced9-4a95-b771-d2b2e409e355 None None] MFA Rules not processed for user `ed3c376c6fff4cf8b1d1d684da93b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:12.279453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-5d12e8c7-ced9-4a95-b771-d2b2e409e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:12.291447 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:12.343942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1464/2891] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:12.348460 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ad07f-5cde-4a9a-aab2-9bf570e2677a admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.409118 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ad07f-5cde-4a9a-aab2-9bf570e2677a admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.413674 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b30c0b-1d93-4e05-ac78-9b2ddb1dbcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.414278 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30c0b-1d93-4e05-ac78-9b2ddb1dbcea admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.415125 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30c0b-1d93-4e05-ac78-9b2ddb1dbcea admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.415404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30c0b-1d93-4e05-ac78-9b2ddb1dbcea admin admin] PATH_INFO: `/v3/projects` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.416075 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b30c0b-1d93-4e05-ac78-9b2ddb1dbcea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.417974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b30c0b-1d93-4e05-ac78-9b2ddb1dbcea admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.442881 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1428/2892] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:12 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:12.446799 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12e8c7-ced9-4a95-b771-d2b2e409e355 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.457393 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12e8c7-ced9-4a95-b771-d2b2e409e355 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.513102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211e19e-24d7-4f52-9da2-d6ac5a46b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.513658 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211e19e-24d7-4f52-9da2-d6ac5a46b1dd admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.513942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211e19e-24d7-4f52-9da2-d6ac5a46b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.514219 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211e19e-24d7-4f52-9da2-d6ac5a46b1dd admin admin] PATH_INFO: `/v3/users` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.514893 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211e19e-24d7-4f52-9da2-d6ac5a46b1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.516895 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211e19e-24d7-4f52-9da2-d6ac5a46b1dd admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.537704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1465/2893] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:12 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:12.542251 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b30c0b-1d93-4e05-ac78-9b2ddb1dbcea admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.552528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b30c0b-1d93-4e05-ac78-9b2ddb1dbcea admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.557126 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194a114-d77d-4fcd-9aa3-1f7d5ccc98c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.557732 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194a114-d77d-4fcd-9aa3-1f7d5ccc98c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.558015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194a114-d77d-4fcd-9aa3-1f7d5ccc98c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.558290 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194a114-d77d-4fcd-9aa3-1f7d5ccc98c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.559072 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194a114-d77d-4fcd-9aa3-1f7d5ccc98c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.560674 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194a114-d77d-4fcd-9aa3-1f7d5ccc98c7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.571147 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1429/2894] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:12.575180 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211e19e-24d7-4f52-9da2-d6ac5a46b1dd admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.585073 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211e19e-24d7-4f52-9da2-d6ac5a46b1dd admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.590242 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b78c5d-0170-48ae-8b13-2dcff6e5d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.590900 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b78c5d-0170-48ae-8b13-2dcff6e5d7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.591218 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b78c5d-0170-48ae-8b13-2dcff6e5d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.591513 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b78c5d-0170-48ae-8b13-2dcff6e5d7ff admin admin] PATH_INFO: `/v3/projects/56291c34165d48e4a8ecb33caf9d8107/users/55b77865529a48e5a198a47a7475e1ca/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.606599 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b78c5d-0170-48ae-8b13-2dcff6e5d7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=56291c34165d48e4a8ecb33caf9d8107, user_id=55b77865529a48e5a198a47a7475e1ca, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.609283 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b78c5d-0170-48ae-8b13-2dcff6e5d7ff admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.622289 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1466/2895] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:12 2022] PUT /identity/v3/projects/56291c34165d48e4a8ecb33caf9d8107/users/55b77865529a48e5a198a47a7475e1ca/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:41:12.626127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194a114-d77d-4fcd-9aa3-1f7d5ccc98c7 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.635963 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194a114-d77d-4fcd-9aa3-1f7d5ccc98c7 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.679725 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:12.692193 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2587a7-c7a3-4f6d-9732-42518608a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.692803 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2587a7-c7a3-4f6d-9732-42518608a422 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.693083 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2587a7-c7a3-4f6d-9732-42518608a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.693357 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2587a7-c7a3-4f6d-9732-42518608a422 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.694039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2587a7-c7a3-4f6d-9732-42518608a422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.695690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2587a7-c7a3-4f6d-9732-42518608a422 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.705282 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1430/2896] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 08:41:12.709369 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b78c5d-0170-48ae-8b13-2dcff6e5d7ff admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.720075 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b78c5d-0170-48ae-8b13-2dcff6e5d7ff admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.725360 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.726023 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.726302 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.726572 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] PATH_INFO: `/v3/projects/56291c34165d48e4a8ecb33caf9d8107/users/55b77865529a48e5a198a47a7475e1ca/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.729191 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56291c34165d48e4a8ecb33caf9d8107, user_id=55b77865529a48e5a198a47a7475e1ca, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.731931 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.742436 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1467/2897] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:12 2022] PUT /identity/v3/projects/56291c34165d48e4a8ecb33caf9d8107/users/55b77865529a48e5a198a47a7475e1ca/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:12.752412 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250447ca-2d8d-4025-a5d7-ee22ad82ee61 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.752704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250447ca-2d8d-4025-a5d7-ee22ad82ee61 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.752991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250447ca-2d8d-4025-a5d7-ee22ad82ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.781602 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-250447ca-2d8d-4025-a5d7-ee22ad82ee61 None None] MFA Rules not processed for user `55b77865529a48e5a198a47a7475e1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:12.782741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-250447ca-2d8d-4025-a5d7-ee22ad82ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:12.848132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1431/2898] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:12.858983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:12.860968 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:12.918663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351328f-cf28-4759-9a83-ea516bc474a5 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:12.922352 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374ed60-9728-43c4-83b4-a96dfbab90e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:12.922983 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ed60-9728-43c4-83b4-a96dfbab90e6 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:12.923268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ed60-9728-43c4-83b4-a96dfbab90e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:12.923543 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ed60-9728-43c4-83b4-a96dfbab90e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:12.932558 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374ed60-9728-43c4-83b4-a96dfbab90e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:12.933989 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374ed60-9728-43c4-83b4-a96dfbab90e6 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:12.943455 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1468/2899] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:13.334440 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250447ca-2d8d-4025-a5d7-ee22ad82ee61 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:13.401624 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250447ca-2d8d-4025-a5d7-ee22ad82ee61 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:13.406084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:13.406714 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:13.407022 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:13.407296 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] PATH_INFO: `/v3/users/ed3c376c6fff4cf8b1d1d684da93b5d4` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:13.408436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3c376c6fff4cf8b1d1d684da93b5d4)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:13.410340 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:13.454777 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3c376c6fff4cf8b1d1d684da93b5d4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:13.461662 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3c376c6fff4cf8b1d1d684da93b5d4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:13.462333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3c376c6fff4cf8b1d1d684da93b5d4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:13.473666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:13.474992 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3c376c6fff4cf8b1d1d684da93b5d4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:13.475810 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3c376c6fff4cf8b1d1d684da93b5d4'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:13.488869 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1432/2900] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:13 2022] DELETE /identity/v3/users/ed3c376c6fff4cf8b1d1d684da93b5d4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:13.494155 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705bfb2-0ae2-46ce-9d1e-a90d60c4c72e None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:13.494625 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705bfb2-0ae2-46ce-9d1e-a90d60c4c72e None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:13.494726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705bfb2-0ae2-46ce-9d1e-a90d60c4c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:13.513850 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-7705bfb2-0ae2-46ce-9d1e-a90d60c4c72e None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:13.515086 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7705bfb2-0ae2-46ce-9d1e-a90d60c4c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:13.520010 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:13.577028 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1469/2901] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:13.586776 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:13.588213 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:13.644571 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aacc3d-ad68-4e7c-9783-1a2661d0021f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:13.649376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7b72-9b3d-4f61-b81c-2d0fa584fec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:13.650253 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7b72-9b3d-4f61-b81c-2d0fa584fec0 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:13.650669 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7b72-9b3d-4f61-b81c-2d0fa584fec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:13.651142 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7b72-9b3d-4f61-b81c-2d0fa584fec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:13.661536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7b72-9b3d-4f61-b81c-2d0fa584fec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:13.662976 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7b72-9b3d-4f61-b81c-2d0fa584fec0 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:13.674660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1433/2902] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:13.939995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705bfb2-0ae2-46ce-9d1e-a90d60c4c72e None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:13.941507 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-7705bfb2-0ae2-46ce-9d1e-a90d60c4c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:13.954457 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705bfb2-0ae2-46ce-9d1e-a90d60c4c72e None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:13.959235 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:13.959947 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:13.960364 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:13.960643 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] PATH_INFO: `/v3/projects/e4a983becef64a00945da7fe9611455c` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:13.962351 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a983becef64a00945da7fe9611455c)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:13.964753 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:14.012433 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a983becef64a00945da7fe9611455c', 'request_id': 'req-50c17496-89d2-46c2-a286-6851208e37cf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.018801 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a983becef64a00945da7fe9611455c', 'request_id': 'req-50c17496-89d2-46c2-a286-6851208e37cf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.024964 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a983becef64a00945da7fe9611455c', 'request_id': 'req-50c17496-89d2-46c2-a286-6851208e37cf'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.035825 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] The token cache is being invalidate because project e4a983becef64a00945da7fe9611455c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:14.036113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.036740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.038231 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1470/2903] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:13 2022] DELETE /identity/v3/projects/e4a983becef64a00945da7fe9611455c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:14.042857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7b72-9b3d-4f61-b81c-2d0fa584fec0 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:14.052422 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7b72-9b3d-4f61-b81c-2d0fa584fec0 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:14.106862 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:14.107446 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.107724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.107995 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] PATH_INFO: `/v3/users/55b77865529a48e5a198a47a7475e1ca` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.109132 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b77865529a48e5a198a47a7475e1ca)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:14.111330 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:14.154783 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b77865529a48e5a198a47a7475e1ca'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.161749 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b77865529a48e5a198a47a7475e1ca'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.162392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b77865529a48e5a198a47a7475e1ca'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.175039 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b77865529a48e5a198a47a7475e1ca'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.175666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-c4323e90-3971-4762-b4e4-61bc1d223205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b77865529a48e5a198a47a7475e1ca'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.187815 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1434/2904] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:14 2022] DELETE /identity/v3/users/55b77865529a48e5a198a47a7475e1ca => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:14.457662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:14.459244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:14.475965 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17496-89d2-46c2-a286-6851208e37cf admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:14.531662 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:14.532286 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.532565 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.532836 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] PATH_INFO: `/v3/projects/56291c34165d48e4a8ecb33caf9d8107` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.533971 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56291c34165d48e4a8ecb33caf9d8107)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:14.535909 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:14.573279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:14.583607 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56291c34165d48e4a8ecb33caf9d8107', 'request_id': 'req-7e5bf0c4-7828-48ed-ba60-9c616046d379'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.591290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56291c34165d48e4a8ecb33caf9d8107', 'request_id': 'req-7e5bf0c4-7828-48ed-ba60-9c616046d379'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.596824 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56291c34165d48e4a8ecb33caf9d8107', 'request_id': 'req-7e5bf0c4-7828-48ed-ba60-9c616046d379'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.608089 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] The token cache is being invalidate because project 56291c34165d48e4a8ecb33caf9d8107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:14.608371 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.608995 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7e5bf0c4-7828-48ed-ba60-9c616046d379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:14.610752 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1471/2905] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:14 2022] DELETE /identity/v3/projects/56291c34165d48e4a8ecb33caf9d8107 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:14.616088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2f97f-c9b6-4d7f-ae2d-7f0dd4dc61b0 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.616541 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2f97f-c9b6-4d7f-ae2d-7f0dd4dc61b0 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.616686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2f97f-c9b6-4d7f-ae2d-7f0dd4dc61b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.636833 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b8f2f97f-c9b6-4d7f-ae2d-7f0dd4dc61b0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:14.637968 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b8f2f97f-c9b6-4d7f-ae2d-7f0dd4dc61b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:14.643088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:14.697951 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1435/2906] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:14.705363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a8ed-e0fd-420d-ad90-9ebdb7c871f3 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.705649 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a8ed-e0fd-420d-ad90-9ebdb7c871f3 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.705926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a8ed-e0fd-420d-ad90-9ebdb7c871f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.725123 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-48b8a8ed-e0fd-420d-ad90-9ebdb7c871f3 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:14.726326 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-48b8a8ed-e0fd-420d-ad90-9ebdb7c871f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:14.734227 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1472/2907] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:14.738434 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2f97f-c9b6-4d7f-ae2d-7f0dd4dc61b0 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:14.748470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2f97f-c9b6-4d7f-ae2d-7f0dd4dc61b0 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:14.753041 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:14.753649 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.753932 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.754207 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.754904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:41:14.755239 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:14.756826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:14.768840 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1436/2908] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:41:14.772936 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8a8ed-e0fd-420d-ad90-9ebdb7c871f3 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:14.782347 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8a8ed-e0fd-420d-ad90-9ebdb7c871f3 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:14.786961 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85209-4c4e-4a83-9bc1-481282b9beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:14.787593 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85209-4c4e-4a83-9bc1-481282b9beb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.787870 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85209-4c4e-4a83-9bc1-481282b9beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.788161 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85209-4c4e-4a83-9bc1-481282b9beb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.788819 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc85209-4c4e-4a83-9bc1-481282b9beb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:14.790702 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc85209-4c4e-4a83-9bc1-481282b9beb5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:14.817275 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1473/2909] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:14 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:14.821268 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:14.831743 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9933cc-572e-4011-becb-92558ddb4f8f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:14.892286 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c522e-3703-43d4-a3e5-7182682086bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:14.892826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c522e-3703-43d4-a3e5-7182682086bc admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.893106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c522e-3703-43d4-a3e5-7182682086bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.893382 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c522e-3703-43d4-a3e5-7182682086bc admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.894046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c522e-3703-43d4-a3e5-7182682086bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:14.895982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c522e-3703-43d4-a3e5-7182682086bc admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:14.916505 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1437/2910] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:14 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:41:14.920633 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85209-4c4e-4a83-9bc1-481282b9beb5 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:14.931473 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85209-4c4e-4a83-9bc1-481282b9beb5 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:14.936077 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cb54d-fd52-414b-9d96-885eae3827ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:14.936686 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cb54d-fd52-414b-9d96-885eae3827ee admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.936974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cb54d-fd52-414b-9d96-885eae3827ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.937249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cb54d-fd52-414b-9d96-885eae3827ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.937945 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cb54d-fd52-414b-9d96-885eae3827ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:14.939598 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cb54d-fd52-414b-9d96-885eae3827ee admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:14.949993 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1474/2911] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:14.953654 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c522e-3703-43d4-a3e5-7182682086bc admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:14.963361 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c522e-3703-43d4-a3e5-7182682086bc admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:14.967931 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644d164-abb6-4a66-9ffd-391526be199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:14.968528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d164-abb6-4a66-9ffd-391526be199e admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:14.968807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d164-abb6-4a66-9ffd-391526be199e admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:14.969079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d164-abb6-4a66-9ffd-391526be199e admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:14.969770 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644d164-abb6-4a66-9ffd-391526be199e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:14.971392 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644d164-abb6-4a66-9ffd-391526be199e admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:14.981885 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1438/2912] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:14.986299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cb54d-fd52-414b-9d96-885eae3827ee admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:14.996788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cb54d-fd52-414b-9d96-885eae3827ee admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.001414 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb53dc-00d8-435e-827f-017325ef0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.002072 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb53dc-00d8-435e-827f-017325ef0e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.002356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb53dc-00d8-435e-827f-017325ef0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.002635 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb53dc-00d8-435e-827f-017325ef0e2b admin admin] PATH_INFO: `/v3/projects/0eb1d7afe18a4ca3bad0597759a8d190/users/b8c013fc63b34ed18e7d3b3931fc2c62/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.017837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb53dc-00d8-435e-827f-017325ef0e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb1d7afe18a4ca3bad0597759a8d190, user_id=b8c013fc63b34ed18e7d3b3931fc2c62, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.020603 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb53dc-00d8-435e-827f-017325ef0e2b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.033279 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1475/2913] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:14 2022] PUT /identity/v3/projects/0eb1d7afe18a4ca3bad0597759a8d190/users/b8c013fc63b34ed18e7d3b3931fc2c62/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:15.044769 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89e20-3b0f-454d-a626-ed9d63b13f9f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.045076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89e20-3b0f-454d-a626-ed9d63b13f9f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.045355 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89e20-3b0f-454d-a626-ed9d63b13f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.072523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-49f89e20-3b0f-454d-a626-ed9d63b13f9f None None] MFA Rules not processed for user `b8c013fc63b34ed18e7d3b3931fc2c62`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:15.073735 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-49f89e20-3b0f-454d-a626-ed9d63b13f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:15.138334 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1439/2914] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:15.142849 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb53dc-00d8-435e-827f-017325ef0e2b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:15.204174 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb53dc-00d8-435e-827f-017325ef0e2b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.208953 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bb45-4536-49de-ab3c-981206daa0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.209573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bb45-4536-49de-ab3c-981206daa0ed admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.209861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bb45-4536-49de-ab3c-981206daa0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.210140 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0bb45-4536-49de-ab3c-981206daa0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.210814 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0bb45-4536-49de-ab3c-981206daa0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.212766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0bb45-4536-49de-ab3c-981206daa0ed admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.239632 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1476/2915] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:15 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:15.244174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89e20-3b0f-454d-a626-ed9d63b13f9f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:15.254673 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89e20-3b0f-454d-a626-ed9d63b13f9f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.258149 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:15.311508 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4d05-d1f9-4ac9-90a5-ece6b7ecd210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.312115 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4d05-d1f9-4ac9-90a5-ece6b7ecd210 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.312395 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4d05-d1f9-4ac9-90a5-ece6b7ecd210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.312668 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4d05-d1f9-4ac9-90a5-ece6b7ecd210 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.313319 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed4d05-d1f9-4ac9-90a5-ece6b7ecd210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.315244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed4d05-d1f9-4ac9-90a5-ece6b7ecd210 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.336029 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1440/2916] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:15 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:15.340011 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bb45-4536-49de-ab3c-981206daa0ed admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:15.350249 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0bb45-4536-49de-ab3c-981206daa0ed admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.355452 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3c6c-72a8-497d-9104-682aa23f8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.356055 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3c6c-72a8-497d-9104-682aa23f8d82 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.356334 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3c6c-72a8-497d-9104-682aa23f8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.356608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3c6c-72a8-497d-9104-682aa23f8d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.357300 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e3c6c-72a8-497d-9104-682aa23f8d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.358919 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e3c6c-72a8-497d-9104-682aa23f8d82 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.370257 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1477/2917] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:15.374199 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4d05-d1f9-4ac9-90a5-ece6b7ecd210 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:15.383982 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4d05-d1f9-4ac9-90a5-ece6b7ecd210 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.388543 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a18f24-33b2-4667-895f-a3140e4e0b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.389186 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a18f24-33b2-4667-895f-a3140e4e0b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.389470 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a18f24-33b2-4667-895f-a3140e4e0b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.389741 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a18f24-33b2-4667-895f-a3140e4e0b15 admin admin] PATH_INFO: `/v3/projects/2f56416d5efb4dbda88a0930736e6f2a/users/39976cbe695844b6b0421fb6100b942b/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.404606 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a18f24-33b2-4667-895f-a3140e4e0b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f56416d5efb4dbda88a0930736e6f2a, user_id=39976cbe695844b6b0421fb6100b942b, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.407244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a18f24-33b2-4667-895f-a3140e4e0b15 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.420560 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1441/2918] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:15 2022] PUT /identity/v3/projects/2f56416d5efb4dbda88a0930736e6f2a/users/39976cbe695844b6b0421fb6100b942b/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 08:41:15.424514 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3c6c-72a8-497d-9104-682aa23f8d82 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:15.434475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3c6c-72a8-497d-9104-682aa23f8d82 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.466380 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:15.492626 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf54ca1-2ff7-4f35-9442-4bb187676851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.493244 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf54ca1-2ff7-4f35-9442-4bb187676851 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.493528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf54ca1-2ff7-4f35-9442-4bb187676851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.493806 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf54ca1-2ff7-4f35-9442-4bb187676851 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.494501 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf54ca1-2ff7-4f35-9442-4bb187676851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.496141 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf54ca1-2ff7-4f35-9442-4bb187676851 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.505955 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1478/2919] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:15.510085 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a18f24-33b2-4667-895f-a3140e4e0b15 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:15.520250 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a18f24-33b2-4667-895f-a3140e4e0b15 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.525333 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.525988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] REQUEST_METHOD: `PUT` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.526274 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.526552 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] PATH_INFO: `/v3/projects/2f56416d5efb4dbda88a0930736e6f2a/users/39976cbe695844b6b0421fb6100b942b/roles/53894f3146884908ba6dd3e118397fb3` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.528553 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f56416d5efb4dbda88a0930736e6f2a, user_id=39976cbe695844b6b0421fb6100b942b, role_id=53894f3146884908ba6dd3e118397fb3)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.531324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.541856 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1442/2920] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:15 2022] PUT /identity/v3/projects/2f56416d5efb4dbda88a0930736e6f2a/users/39976cbe695844b6b0421fb6100b942b/roles/53894f3146884908ba6dd3e118397fb3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:15.551677 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212d59-7252-46c4-9aa5-aeebd04b928d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.552131 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212d59-7252-46c4-9aa5-aeebd04b928d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.552245 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c212d59-7252-46c4-9aa5-aeebd04b928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.579530 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-8c212d59-7252-46c4-9aa5-aeebd04b928d None None] MFA Rules not processed for user `39976cbe695844b6b0421fb6100b942b`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:15.580738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-8c212d59-7252-46c4-9aa5-aeebd04b928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:15.646481 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1479/2921] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:15.658867 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:15.660558 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:15.717063 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf710094-56d4-4f7f-84fa-7a750e14980d admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.720644 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6850f5d-ba2c-4fe1-972f-6d5d91274637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.721248 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850f5d-ba2c-4fe1-972f-6d5d91274637 service cinder] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.721528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850f5d-ba2c-4fe1-972f-6d5d91274637 service cinder] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.721807 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850f5d-ba2c-4fe1-972f-6d5d91274637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.731220 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6850f5d-ba2c-4fe1-972f-6d5d91274637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.732640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6850f5d-ba2c-4fe1-972f-6d5d91274637 service cinder] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.742186 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1443/2922] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:15.814584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c212d59-7252-46c4-9aa5-aeebd04b928d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:15.825652 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c212d59-7252-46c4-9aa5-aeebd04b928d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:15.830323 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e774938-341e-4e9c-866f-5164faeb53d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:15.830973 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e774938-341e-4e9c-866f-5164faeb53d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:15.831259 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e774938-341e-4e9c-866f-5164faeb53d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:15.831534 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e774938-341e-4e9c-866f-5164faeb53d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:15.889714 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e774938-341e-4e9c-866f-5164faeb53d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:15.891353 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e774938-341e-4e9c-866f-5164faeb53d4 service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:15.900788 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1480/2923] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:16.156513 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6850f5d-ba2c-4fe1-972f-6d5d91274637 service cinder] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:16.218056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6850f5d-ba2c-4fe1-972f-6d5d91274637 service cinder] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:16.222516 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:16.223185 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:16.223471 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:16.223746 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] PATH_INFO: `/v3/users/b8c013fc63b34ed18e7d3b3931fc2c62` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:16.224902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c013fc63b34ed18e7d3b3931fc2c62)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:16.226820 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:16.229144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:16.273452 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c013fc63b34ed18e7d3b3931fc2c62'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.280324 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c013fc63b34ed18e7d3b3931fc2c62'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.280996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c013fc63b34ed18e7d3b3931fc2c62'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.292908 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c013fc63b34ed18e7d3b3931fc2c62'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.293547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c013fc63b34ed18e7d3b3931fc2c62'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.306650 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1444/2924] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:16 2022] DELETE /identity/v3/users/b8c013fc63b34ed18e7d3b3931fc2c62 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:16.311268 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6624a-482a-4787-9c05-5dcd947b2c92 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:16.311563 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6624a-482a-4787-9c05-5dcd947b2c92 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:16.311845 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6624a-482a-4787-9c05-5dcd947b2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:16.332254 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-9cd6624a-482a-4787-9c05-5dcd947b2c92 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:16.333475 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9cd6624a-482a-4787-9c05-5dcd947b2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:16.380251 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=100 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:16.392335 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1481/2925] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:16.401962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:16.403404 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:16.459484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce476db-6a52-4f98-bd49-0b0ddffb4ec7 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:16.463224 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6853b8-ef8e-44bc-8b4d-6adfd921f98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:16.463887 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6853b8-ef8e-44bc-8b4d-6adfd921f98a service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:16.464108 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6853b8-ef8e-44bc-8b4d-6adfd921f98a service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:16.464381 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6853b8-ef8e-44bc-8b4d-6adfd921f98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:16.473998 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6853b8-ef8e-44bc-8b4d-6adfd921f98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:16.475390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6853b8-ef8e-44bc-8b4d-6adfd921f98a service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:16.484790 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1445/2926] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:16.749066 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6624a-482a-4787-9c05-5dcd947b2c92 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:16.750628 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-9cd6624a-482a-4787-9c05-5dcd947b2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:16.764405 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6624a-482a-4787-9c05-5dcd947b2c92 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:16.770158 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:16.770882 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:16.771252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:16.771450 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] PATH_INFO: `/v3/projects/0eb1d7afe18a4ca3bad0597759a8d190` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:16.772634 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb1d7afe18a4ca3bad0597759a8d190)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:16.774528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:16.820869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb1d7afe18a4ca3bad0597759a8d190', 'request_id': 'req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.828036 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb1d7afe18a4ca3bad0597759a8d190', 'request_id': 'req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.833663 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb1d7afe18a4ca3bad0597759a8d190', 'request_id': 'req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.844942 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] The token cache is being invalidate because project 0eb1d7afe18a4ca3bad0597759a8d190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:16.845231 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.845869 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.847729 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1482/2927] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:16 2022] DELETE /identity/v3/projects/0eb1d7afe18a4ca3bad0597759a8d190 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:16.851462 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6853b8-ef8e-44bc-8b4d-6adfd921f98a service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:16.861724 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6853b8-ef8e-44bc-8b4d-6adfd921f98a service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:16.922105 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:16.922733 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:16.923049 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:16.923326 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] PATH_INFO: `/v3/users/39976cbe695844b6b0421fb6100b942b` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:16.924474 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39976cbe695844b6b0421fb6100b942b)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:16.926377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:16.952226 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:16.972182 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39976cbe695844b6b0421fb6100b942b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.979641 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39976cbe695844b6b0421fb6100b942b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.980294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39976cbe695844b6b0421fb6100b942b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.992484 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39976cbe695844b6b0421fb6100b942b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:16.993070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-8bde8a37-8f8f-4b94-92a5-c0e54b48d764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39976cbe695844b6b0421fb6100b942b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:17.004857 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1446/2928] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:16 2022] DELETE /identity/v3/users/39976cbe695844b6b0421fb6100b942b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:17.269042 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:17.270538 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:17.285735 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0441c28-0e1e-4f4a-b6a8-6137a08c31a5 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:17.341726 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:17.342365 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.342645 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.342917 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] PATH_INFO: `/v3/projects/2f56416d5efb4dbda88a0930736e6f2a` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.344085 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f56416d5efb4dbda88a0930736e6f2a)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:17.346012 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:17.390145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f56416d5efb4dbda88a0930736e6f2a', 'request_id': 'req-7f02a7bd-ca75-466a-8944-59f7ff90014e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:17.396608 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f56416d5efb4dbda88a0930736e6f2a', 'request_id': 'req-7f02a7bd-ca75-466a-8944-59f7ff90014e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:17.402896 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f56416d5efb4dbda88a0930736e6f2a', 'request_id': 'req-7f02a7bd-ca75-466a-8944-59f7ff90014e'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:17.413659 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] The token cache is being invalidate because project 2f56416d5efb4dbda88a0930736e6f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:17.413952 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:17.414578 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-7f02a7bd-ca75-466a-8944-59f7ff90014e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:17.416164 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1483/2929] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:17 2022] DELETE /identity/v3/projects/2f56416d5efb4dbda88a0930736e6f2a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:17.421176 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20354522-515b-4adc-85f9-c857f0194b86 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.421468 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20354522-515b-4adc-85f9-c857f0194b86 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.421747 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20354522-515b-4adc-85f9-c857f0194b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.440920 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-20354522-515b-4adc-85f9-c857f0194b86 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:17.442128 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-20354522-515b-4adc-85f9-c857f0194b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:17.499795 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1447/2930] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:17.509420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440af017-4580-464a-a460-22e47e7bea1d None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.509704 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440af017-4580-464a-a460-22e47e7bea1d None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.509979 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440af017-4580-464a-a460-22e47e7bea1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.530528 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-440af017-4580-464a-a460-22e47e7bea1d None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:17.531701 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-440af017-4580-464a-a460-22e47e7bea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:17.539644 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1484/2931] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:17.543911 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20354522-515b-4adc-85f9-c857f0194b86 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:17.553603 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20354522-515b-4adc-85f9-c857f0194b86 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:17.558186 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:17.558796 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.559109 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.559387 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.560084 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:41:17.560390 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:17.561974 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:17.573855 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1448/2932] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 08:41:17.578088 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440af017-4580-464a-a460-22e47e7bea1d None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:17.582508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:17.589358 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440af017-4580-464a-a460-22e47e7bea1d None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:17.594758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad7e83-ea4e-443f-a5d1-55d0582e3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:17.595399 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad7e83-ea4e-443f-a5d1-55d0582e3a53 admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.595683 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad7e83-ea4e-443f-a5d1-55d0582e3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.595960 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad7e83-ea4e-443f-a5d1-55d0582e3a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.596641 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad7e83-ea4e-443f-a5d1-55d0582e3a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:17.598545 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad7e83-ea4e-443f-a5d1-55d0582e3a53 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:17.625970 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1485/2933] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:17 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:17.630106 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:17.640559 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64bf1e-f97d-44f1-8bd6-ecc6dfaa876f admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:17.697762 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5746-38be-4a4e-95c5-a69b3ccfbe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:17.698376 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5746-38be-4a4e-95c5-a69b3ccfbe71 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.698660 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5746-38be-4a4e-95c5-a69b3ccfbe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.698959 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5746-38be-4a4e-95c5-a69b3ccfbe71 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.699626 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad5746-38be-4a4e-95c5-a69b3ccfbe71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:17.701532 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad5746-38be-4a4e-95c5-a69b3ccfbe71 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:17.722079 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1449/2934] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:17 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:41:17.726216 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad7e83-ea4e-443f-a5d1-55d0582e3a53 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:17.736584 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad7e83-ea4e-443f-a5d1-55d0582e3a53 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:17.741184 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cdd4c-d2cf-4c12-9ae5-c338f96aa1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:17.741786 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cdd4c-d2cf-4c12-9ae5-c338f96aa1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.742063 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cdd4c-d2cf-4c12-9ae5-c338f96aa1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.742826 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cdd4c-d2cf-4c12-9ae5-c338f96aa1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.743549 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cdd4c-d2cf-4c12-9ae5-c338f96aa1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:17.745130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cdd4c-d2cf-4c12-9ae5-c338f96aa1d7 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:17.760325 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1486/2935] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:17.764257 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5746-38be-4a4e-95c5-a69b3ccfbe71 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:17.774216 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5746-38be-4a4e-95c5-a69b3ccfbe71 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:17.778879 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8d8f2-370c-44dc-a195-93e1ce6a306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:17.779528 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8d8f2-370c-44dc-a195-93e1ce6a306c admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.779811 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8d8f2-370c-44dc-a195-93e1ce6a306c admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.780088 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8d8f2-370c-44dc-a195-93e1ce6a306c admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.780854 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8d8f2-370c-44dc-a195-93e1ce6a306c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:17.782389 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8d8f2-370c-44dc-a195-93e1ce6a306c admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:17.792909 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1450/2936] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:17.796787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cdd4c-d2cf-4c12-9ae5-c338f96aa1d7 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:17.807420 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cdd4c-d2cf-4c12-9ae5-c338f96aa1d7 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:17.812177 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:17.812861 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.813145 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.813424 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] PATH_INFO: `/v3/projects/1eb236c2f989454090c29618c54e5c56/users/f5f0ae2398674bfc9d94511a62bab20a/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.828624 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb236c2f989454090c29618c54e5c56, user_id=f5f0ae2398674bfc9d94511a62bab20a, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:17.831311 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:17.849829 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1487/2937] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:17 2022] PUT /identity/v3/projects/1eb236c2f989454090c29618c54e5c56/users/f5f0ae2398674bfc9d94511a62bab20a/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:17.854415 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16ea9-2c2c-4b6f-9120-634da8ad185b None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:17.854826 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16ea9-2c2c-4b6f-9120-634da8ad185b None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:17.854996 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16ea9-2c2c-4b6f-9120-634da8ad185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:17.875099 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:17.885488 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-b3f16ea9-2c2c-4b6f-9120-634da8ad185b None None] MFA Rules not processed for user `f5f0ae2398674bfc9d94511a62bab20a`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:17.886935 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-b3f16ea9-2c2c-4b6f-9120-634da8ad185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:17.949629 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1451/2938] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:17 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:17.981366 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:17.983102 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:18.040320 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8f214-5fac-4cb5-8fb5-c9b4fd1ae3b1 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:18.043941 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10e4f3-8a5a-46c9-906f-a91bba206e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:18.044553 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e4f3-8a5a-46c9-906f-a91bba206e9f service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.044837 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e4f3-8a5a-46c9-906f-a91bba206e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.045116 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e4f3-8a5a-46c9-906f-a91bba206e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.053361 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10e4f3-8a5a-46c9-906f-a91bba206e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:18.055363 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10e4f3-8a5a-46c9-906f-a91bba206e9f service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:18.064181 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1488/2939] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:17 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:18.078705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f16ea9-2c2c-4b6f-9120-634da8ad185b None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:18.138823 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f16ea9-2c2c-4b6f-9120-634da8ad185b None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:18.143367 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:18.143991 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.144289 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.144547 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] PATH_INFO: `/v3/users/f5f0ae2398674bfc9d94511a62bab20a` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.145705 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f0ae2398674bfc9d94511a62bab20a)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:18.147671 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:18.192898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f0ae2398674bfc9d94511a62bab20a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.199779 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f0ae2398674bfc9d94511a62bab20a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.200450 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f0ae2398674bfc9d94511a62bab20a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.212041 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f0ae2398674bfc9d94511a62bab20a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.212687 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f0ae2398674bfc9d94511a62bab20a'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.224501 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1452/2940] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:18 2022] DELETE /identity/v3/users/f5f0ae2398674bfc9d94511a62bab20a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:18.229592 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa709f9-6236-4b42-9279-dce8d4e731c0 None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.229884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa709f9-6236-4b42-9279-dce8d4e731c0 None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.230163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa709f9-6236-4b42-9279-dce8d4e731c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.249877 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-ffa709f9-6236-4b42-9279-dce8d4e731c0 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:18.251128 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ffa709f9-6236-4b42-9279-dce8d4e731c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:18.308446 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1489/2941] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:18.317847 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:18.319294 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:18.338827 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:18.377918 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4774c-536f-4dcc-be4a-b03cc86d33cf admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:18.381640 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784f98b-c98e-4e01-ae3d-b8d13964ed84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:18.382244 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784f98b-c98e-4e01-ae3d-b8d13964ed84 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.382523 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784f98b-c98e-4e01-ae3d-b8d13964ed84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.382792 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784f98b-c98e-4e01-ae3d-b8d13964ed84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.391717 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784f98b-c98e-4e01-ae3d-b8d13964ed84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:18.393127 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784f98b-c98e-4e01-ae3d-b8d13964ed84 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:18.402979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1453/2942] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:18.662637 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa709f9-6236-4b42-9279-dce8d4e731c0 None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:18.664146 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-ffa709f9-6236-4b42-9279-dce8d4e731c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:18.677469 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa709f9-6236-4b42-9279-dce8d4e731c0 None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:18.682299 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:18.682984 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.683271 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.683550 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] PATH_INFO: `/v3/projects/1eb236c2f989454090c29618c54e5c56` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.684741 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb236c2f989454090c29618c54e5c56)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:18.686671 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:18.731117 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:18.735377 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb236c2f989454090c29618c54e5c56', 'request_id': 'req-5659c151-44e8-433c-8732-bdef1b11965b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.742802 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb236c2f989454090c29618c54e5c56', 'request_id': 'req-5659c151-44e8-433c-8732-bdef1b11965b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.748290 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb236c2f989454090c29618c54e5c56', 'request_id': 'req-5659c151-44e8-433c-8732-bdef1b11965b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.759798 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] The token cache is being invalidate because project 1eb236c2f989454090c29618c54e5c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:18.760092 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.760738 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-5659c151-44e8-433c-8732-bdef1b11965b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:18.762890 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1490/2943] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:18 2022] DELETE /identity/v3/projects/1eb236c2f989454090c29618c54e5c56 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:18.769070 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e758-4a7c-4b79-8960-462fe9458943 None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.769690 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e758-4a7c-4b79-8960-462fe9458943 None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.769979 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e758-4a7c-4b79-8960-462fe9458943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.789828 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-0aa2e758-4a7c-4b79-8960-462fe9458943 None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:18.791086 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-0aa2e758-4a7c-4b79-8960-462fe9458943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:18.856033 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1454/2944] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:18.864517 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c9b5-0505-44d9-b0e8-b1ee9bcff5af None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.864821 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c9b5-0505-44d9-b0e8-b1ee9bcff5af None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.865295 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c9b5-0505-44d9-b0e8-b1ee9bcff5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.888024 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-0a76c9b5-0505-44d9-b0e8-b1ee9bcff5af None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:18.889322 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-0a76c9b5-0505-44d9-b0e8-b1ee9bcff5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:18.897926 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1491/2945] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:18.902978 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e758-4a7c-4b79-8960-462fe9458943 None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:18.913144 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e758-4a7c-4b79-8960-462fe9458943 None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:18.917904 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:18.918537 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.918824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.919138 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.919853 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91861) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 08:41:18.920164 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:18.921784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:18.934536 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1455/2946] 10.222.0.46 () {58 vars in 1153 bytes} [Tue Jul 26 08:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 08:41:18.938889 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c9b5-0505-44d9-b0e8-b1ee9bcff5af None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:18.949139 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c9b5-0505-44d9-b0e8-b1ee9bcff5af None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:18.953935 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919499f-f952-47c1-b645-322ddb055a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:18.954548 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919499f-f952-47c1-b645-322ddb055a3c admin admin] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:18.954833 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919499f-f952-47c1-b645-322ddb055a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:18.955136 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919499f-f952-47c1-b645-322ddb055a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:18.955859 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919499f-f952-47c1-b645-322ddb055a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:18.957766 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919499f-f952-47c1-b645-322ddb055a3c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:18.988695 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1492/2947] 10.222.0.46 () {60 vars in 1153 bytes} [Tue Jul 26 08:41:18 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 08:41:18.989824 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:18.999756 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03975a-0a21-4377-b252-d0f934ea9f7b admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:19.055061 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10328aa4-7717-4b7f-bb83-f3f98f374ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:19.055677 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10328aa4-7717-4b7f-bb83-f3f98f374ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:19.055962 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10328aa4-7717-4b7f-bb83-f3f98f374ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:19.056241 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10328aa4-7717-4b7f-bb83-f3f98f374ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:19.056902 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10328aa4-7717-4b7f-bb83-f3f98f374ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:19.058834 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10328aa4-7717-4b7f-bb83-f3f98f374ed1 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:19.079931 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1456/2948] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jul 26 08:41:18 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 08:41:19.083974 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919499f-f952-47c1-b645-322ddb055a3c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:19.094792 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919499f-f952-47c1-b645-322ddb055a3c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:19.099407 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33e527-44af-47c1-87ac-1f713b54ed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:19.100061 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33e527-44af-47c1-87ac-1f713b54ed94 admin admin] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:19.100293 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33e527-44af-47c1-87ac-1f713b54ed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:19.100569 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33e527-44af-47c1-87ac-1f713b54ed94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:19.101260 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33e527-44af-47c1-87ac-1f713b54ed94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:19.102852 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33e527-44af-47c1-87ac-1f713b54ed94 admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:19.113356 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1493/2949] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:19.118577 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10328aa4-7717-4b7f-bb83-f3f98f374ed1 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:19.128383 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10328aa4-7717-4b7f-bb83-f3f98f374ed1 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:19.133486 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101df556-3795-49b2-8765-04c7a95effe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:19.134097 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101df556-3795-49b2-8765-04c7a95effe6 admin admin] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:19.134377 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101df556-3795-49b2-8765-04c7a95effe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:19.134681 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101df556-3795-49b2-8765-04c7a95effe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:19.135436 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101df556-3795-49b2-8765-04c7a95effe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:19.137015 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101df556-3795-49b2-8765-04c7a95effe6 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:19.147348 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1457/2950] 10.222.0.46 () {58 vars in 1122 bytes} [Tue Jul 26 08:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 08:41:19.151453 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33e527-44af-47c1-87ac-1f713b54ed94 admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:19.161324 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33e527-44af-47c1-87ac-1f713b54ed94 admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:19.165924 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:19.166573 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] REQUEST_METHOD: `PUT` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:19.166854 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:19.167163 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] PATH_INFO: `/v3/projects/6f005b3bde2b4fdbaaff8055cf028575/users/bf45f77bf84f4810a0b7e3793276840b/roles/76ec473c1ae74b7880a67166a2fe69ab` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:19.181827 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f005b3bde2b4fdbaaff8055cf028575, user_id=bf45f77bf84f4810a0b7e3793276840b, role_id=76ec473c1ae74b7880a67166a2fe69ab)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:19.184508 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:19.197531 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1494/2951] 10.222.0.46 () {60 vars in 1483 bytes} [Tue Jul 26 08:41:19 2022] PUT /identity/v3/projects/6f005b3bde2b4fdbaaff8055cf028575/users/bf45f77bf84f4810a0b7e3793276840b/roles/76ec473c1ae74b7880a67166a2fe69ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:19.271469 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa1b8-32b3-4aa1-8327-210bb2e3019f None None] REQUEST_METHOD: `POST` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:19.271758 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa1b8-32b3-4aa1-8327-210bb2e3019f None None] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:19.272032 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa1b8-32b3-4aa1-8327-210bb2e3019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:19.299321 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.auth.core [None req-014fa1b8-32b3-4aa1-8327-210bb2e3019f None None] MFA Rules not processed for user `bf45f77bf84f4810a0b7e3793276840b`. Rule list: `[]` (Enabled: `True`). {{(pid=91861) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:19.300533 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-014fa1b8-32b3-4aa1-8327-210bb2e3019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:19.313291 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:19.366046 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1458/2952] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:19.377758 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:19.379488 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:19.434887 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3dd5a-b276-492e-985f-73528fdf088c admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:19.438559 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57838318-bf8e-4ddf-acd3-373b406d516c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1886d36711f4ca48191ebfbee3e9a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:19.439186 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838318-bf8e-4ddf-acd3-373b406d516c service cinder] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:19.439467 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838318-bf8e-4ddf-acd3-373b406d516c service cinder] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:19.439740 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838318-bf8e-4ddf-acd3-373b406d516c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:19.448648 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57838318-bf8e-4ddf-acd3-373b406d516c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:19.450090 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57838318-bf8e-4ddf-acd3-373b406d516c service cinder] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:19.459037 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1495/2953] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:28.524805 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa1b8-32b3-4aa1-8327-210bb2e3019f None None] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:28.584429 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa1b8-32b3-4aa1-8327-210bb2e3019f None None] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:28.589590 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:28.590222 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:28.590507 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:28.590784 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] PATH_INFO: `/v3/users/bf45f77bf84f4810a0b7e3793276840b` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:28.591988 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf45f77bf84f4810a0b7e3793276840b)` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:28.593898 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:28.638069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf45f77bf84f4810a0b7e3793276840b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:28.645745 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf45f77bf84f4810a0b7e3793276840b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:28.646464 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf45f77bf84f4810a0b7e3793276840b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:28.661284 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf45f77bf84f4810a0b7e3793276840b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:28.661925 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.notifications [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf45f77bf84f4810a0b7e3793276840b'} {{(pid=91861) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:28.674752 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1459/2954] 10.222.0.46 () {58 vars in 1224 bytes} [Tue Jul 26 08:41:28 2022] DELETE /identity/v3/users/bf45f77bf84f4810a0b7e3793276840b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:28.679333 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e32f8-12f4-4b11-a493-4b9cfe8de1dd None None] REQUEST_METHOD: `POST` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:28.679815 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e32f8-12f4-4b11-a493-4b9cfe8de1dd None None] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:28.680034 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e32f8-12f4-4b11-a493-4b9cfe8de1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:28.699864 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.auth.core [None req-309e32f8-12f4-4b11-a493-4b9cfe8de1dd None None] MFA Rules not processed for user `312d9f01937f4f95a328912567973a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 08:41:28.701113 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-309e32f8-12f4-4b11-a493-4b9cfe8de1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:28.758851 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1496/2955] 10.222.0.46 () {58 vars in 958 bytes} [Tue Jul 26 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 08:41:28.768782 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:28.770331 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:28.810053 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:28.829456 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbfee9-69f5-4480-a817-fd95fc841ac5 admin admin] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:28.833069 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a234b8e5f2472cb3e733f933ca1f4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:28.833676 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:28.833956 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:28.834229 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:28.844174 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:28.845665 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:28.855572 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1460/2956] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:29.113940 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e32f8-12f4-4b11-a493-4b9cfe8de1dd None None] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:29.115422 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-309e32f8-12f4-4b11-a493-4b9cfe8de1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:29.129723 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e32f8-12f4-4b11-a493-4b9cfe8de1dd None None] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:29.134911 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '312d9f01937f4f95a328912567973a43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e4e301f72114302a7a6060f88f11bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:29.135580 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:29.135860 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:29.136768 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] PATH_INFO: `/v3/projects/6f005b3bde2b4fdbaaff8055cf028575` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:29.138111 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f005b3bde2b4fdbaaff8055cf028575)` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:29.140051 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:29.147152 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:29.189074 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f005b3bde2b4fdbaaff8055cf028575', 'request_id': 'req-853e19c8-8c66-4c01-8d57-f0b13e35735b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:29.196699 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f005b3bde2b4fdbaaff8055cf028575', 'request_id': 'req-853e19c8-8c66-4c01-8d57-f0b13e35735b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:29.203103 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f005b3bde2b4fdbaaff8055cf028575', 'request_id': 'req-853e19c8-8c66-4c01-8d57-f0b13e35735b'} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:29.214168 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] The token cache is being invalidate because project 6f005b3bde2b4fdbaaff8055cf028575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 08:41:29.214460 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:29.215130 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.notifications [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 08:41:29.216646 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1497/2957] 10.222.0.46 () {58 vars in 1233 bytes} [Tue Jul 26 08:41:29 2022] DELETE /identity/v3/projects/6f005b3bde2b4fdbaaff8055cf028575 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 08:41:38.851076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=10 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:39.211540 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG dbcounter [-] [91860] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:41:47.240666 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] Authenticating user token {{(pid=91861) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:41:47.242173 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:47.338874 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e98e-38e1-4c96-842c-cdff860ebe09 service neutron] Validating token access rules against request {{(pid=91861) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:41:47.398076 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f6a9a-94d2-4d21-91b0-9eb565bc3cab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91861) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:41:47.398704 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6a9a-94d2-4d21-91b0-9eb565bc3cab service placement] REQUEST_METHOD: `GET` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:41:47.399028 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6a9a-94d2-4d21-91b0-9eb565bc3cab service placement] SCRIPT_NAME: `/identity` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:41:47.399311 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6a9a-94d2-4d21-91b0-9eb565bc3cab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91861) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:41:47.401686 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.fernet_utils [None req-8b4f6a9a-94d2-4d21-91b0-9eb565bc3cab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91861) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:41:47.412764 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f6a9a-94d2-4d21-91b0-9eb565bc3cab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:41:47.414352 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f6a9a-94d2-4d21-91b0-9eb565bc3cab service placement] RBAC: Authorization granted {{(pid=91861) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:41:47.424260 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: [pid: 91861|app: 0|req: 1461/2958] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:41:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 08:41:57.420056 dv-cinder-836973-16-iscsi devstack@keystone.service[91861]: DEBUG dbcounter [-] [91861] Writing DB stats keystone:SELECT=71 {{(pid=91861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 08:46:52.151736 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] Authenticating user token {{(pid=91860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 08:46:52.153154 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.fernet_utils [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 08:46:52.229787 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e19c8-8c66-4c01-8d57-f0b13e35735b admin admin] Validating token access rules against request {{(pid=91860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 08:46:52.234888 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332453a-c6d4-4ddb-a1cd-7eacd39b9d5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98df09d65184729b62b2ae1904a27ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18140b27db544c5588e167b3ec29ca54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 08:46:52.235612 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332453a-c6d4-4ddb-a1cd-7eacd39b9d5e service placement] REQUEST_METHOD: `GET` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 08:46:52.235891 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332453a-c6d4-4ddb-a1cd-7eacd39b9d5e service placement] SCRIPT_NAME: `/identity` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 08:46:52.236162 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332453a-c6d4-4ddb-a1cd-7eacd39b9d5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 08:46:52.246246 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332453a-c6d4-4ddb-a1cd-7eacd39b9d5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 08:46:52.247884 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332453a-c6d4-4ddb-a1cd-7eacd39b9d5e service placement] RBAC: Authorization granted {{(pid=91860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 08:46:52.258252 dv-cinder-836973-16-iscsi devstack@keystone.service[91860]: [pid: 91860|app: 0|req: 1498/2959] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jul 26 08:46:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)